-- Logs begin at Wed 2022-09-14 11:10:52 UTC, end at Wed 2022-09-14 12:34:52 UTC. -- Sep 14 11:56:46.807661 dv-cinder-844962-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 11:56:46.816700 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 11:56:46 2022] *** Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: nodename: dv-cinder-844962-2-iscsi Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: machine: x86_64 Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: clock source: unix Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: pcre jit disabled Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: detected number of CPU cores: 4 Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: current working directory: / Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: detected binary path: /usr/bin/uwsgi-core Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: your processes number limit is 47680 Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: your memory page size is 4096 bytes Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: detected max file descriptor number: 2048 Sep 14 11:56:46.818766 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: lock engine: pthread robust mutexes Sep 14 11:56:46.819942 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: thunder lock: enabled Sep 14 11:56:46.819942 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 11:56:46.819942 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 11:56:46.862127 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: Python main interpreter initialized at 0x5568349ff9c0 Sep 14 11:56:46.862127 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: python threads support enabled Sep 14 11:56:46.862127 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: your server socket listen backlog is limited to 100 connections Sep 14 11:56:46.862127 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: your mercy for graceful operations on workers is 90 seconds Sep 14 11:56:46.862603 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 11:56:46.862603 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: *** Operational MODE: preforking *** Sep 14 11:56:46.862838 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: *** uWSGI is running in multiple interpreter mode *** Sep 14 11:56:46.862838 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: spawned uWSGI master process (pid: 106082) Sep 14 11:56:46.863057 dv-cinder-844962-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 14 11:56:46.863777 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: spawned uWSGI worker 1 (pid: 106083, cores: 1) Sep 14 11:56:46.863977 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: spawned uWSGI worker 2 (pid: 106084, cores: 1) Sep 14 11:56:46.865361 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 11:56:47.556174 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 11:56:47.583704 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 11:56:48.653812 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 11:56:48.653812 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: from cryptography.utils import int_from_bytes Sep 14 11:56:48.654528 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 11:56:48.654528 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: from cryptography.utils import int_from_bytes Sep 14 11:56:48.699843 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 11:56:48.699843 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: from cryptography.utils import int_from_bytes Sep 14 11:56:48.700463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 11:56:48.700463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: from cryptography.utils import int_from_bytes Sep 14 11:56:51.196274 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 11:56:51.196954 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 11:56:51.197054 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 11:56:51.197389 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 11:56:51.197647 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 11:56:51.198066 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.198160 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 11:56:51.198524 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 11:56:51.198620 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.198700 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.198891 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 11:56:51.198993 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.199251 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 11:56:51.199354 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.199511 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 11:56:51.199602 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.199900 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.200017 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.200219 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.200314 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.200540 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.200641 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.200795 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.200899 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.201107 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.201203 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.201431 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844962-2-iscsi {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.201540 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.201748 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.201891 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.202079 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.202176 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.202384 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.202478 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.202669 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.202769 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.202985 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.203076 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.203307 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.203454 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844962-2-iscsi {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.203603 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.203699 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.204007 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.204132 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.204523 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.204651 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.204776 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.204891 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.204997 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.205108 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.205218 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.205438 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.205578 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.205733 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.206255 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.206420 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.206420 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.206649 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.206739 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.206820 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.206974 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.207065 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.207282 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.207431 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.207885 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.209141 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844962-2-iscsi {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.209276 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.209491 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.209491 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.209695 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.209787 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.209905 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.209905 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.210120 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.210214 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.210433 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.210433 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.210682 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844962-2-iscsi {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.210765 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.210910 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.211008 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.211626 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.211711 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.211790 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.211875 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.211961 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.212051 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.212131 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.212220 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.212220 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.212371 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.212515 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.212793 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.212880 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.213117 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.213214 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.213434 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.213569 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.213737 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.213822 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.214062 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.214164 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.214313 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.214509 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.214607 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.214816 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.214973 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.215146 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.215290 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.215529 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.215641 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.215804 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.215893 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.216081 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.216177 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.216395 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.216529 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.216712 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.216798 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.216965 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.217064 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.217275 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.217363 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.217597 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.217682 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.217921 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.218025 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.218227 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.218315 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.218496 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.218582 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.218750 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.218844 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.219070 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.219163 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.219390 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.219486 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.219699 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.219786 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.220007 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.220092 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.220310 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.220422 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.220617 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.220737 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.220924 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.221011 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.221245 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.221355 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.221561 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.221725 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.221885 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.221998 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.222213 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.222311 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.222530 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.222618 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.222854 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.222940 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.223163 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.223257 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.223484 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.223576 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.223790 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.223881 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.224096 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.224189 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.224414 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.224498 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.224745 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.224830 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.225053 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.225138 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.225304 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.225389 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.225603 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.225695 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.225928 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.226019 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.226251 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.226398 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.226573 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.226713 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.227374 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.227455 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.227679 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.227772 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.227976 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.228093 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.228281 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.228401 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.228584 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.228668 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.228895 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.229018 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.229192 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.229277 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.229493 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.229579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.229795 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.229916 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.230121 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.230207 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.230425 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.230618 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.230710 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.230939 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.231091 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.231231 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.231367 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.231544 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.231688 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.231845 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.231938 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.232142 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.232234 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.232448 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.232542 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.232756 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.232842 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.233060 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.233145 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.233365 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.233449 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.233666 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.233755 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.233994 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.234106 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.234313 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.234536 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.234629 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.234760 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.234910 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.235119 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.235228 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.235358 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.235480 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.235649 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.235816 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.235960 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.236120 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.236283 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.236403 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.236558 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.236667 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.236865 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.236967 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.237185 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.237276 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.237490 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.237576 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.237794 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.237901 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.238146 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.238232 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.238447 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.238540 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.238745 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.238829 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.239044 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.239130 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.239338 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.239442 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.239644 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.239780 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.239958 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.240060 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.240262 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.240348 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.240562 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.240679 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.240869 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.241034 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.241173 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.241327 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.241498 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.241594 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.241826 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.241934 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.242187 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.242293 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.242550 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.242676 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.242856 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.243012 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.243179 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.243343 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.243501 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.243660 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.243812 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.243970 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.244119 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.244282 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.244425 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.244606 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.244743 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:56:51.244921 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.245079 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.245231 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.245417 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.245539 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.245760 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.245846 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.246103 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.246204 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.246488 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.246583 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.246791 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.246921 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.247104 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.247197 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.247419 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.247516 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.247727 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.247822 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.248042 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.248128 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.248365 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.248451 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.248674 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.248758 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.248979 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.249077 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.249298 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.249389 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.249622 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.249714 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.249967 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.250073 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.250351 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.250442 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.250674 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.250762 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.251034 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.251148 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.251291 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.251379 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.251599 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.251692 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.251944 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.252051 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.252256 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.252368 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.252574 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.252696 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.253119 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.253613 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.254126 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.254253 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.254348 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.255539 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.256215 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.256363 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.256615 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.256751 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.256880 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.257047 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.257182 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.257302 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.257437 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.257563 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.257692 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.257808 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.258035 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.258178 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.258308 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.258439 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.258578 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.258799 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.258897 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.258966 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.259071 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.259199 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.259307 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.259439 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.259563 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.259692 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.259782 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.259850 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.259923 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260006 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260075 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260141 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260141 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260275 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260349 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260426 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260495 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260561 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260626 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260690 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260764 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260832 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260898 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.260962 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.261067 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.261317 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.261412 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.261534 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.261650 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.261847 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.261986 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.262180 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.262280 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.262493 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.262582 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.262801 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.262888 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.263115 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.263212 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.263428 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.263516 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.263735 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.263832 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.264057 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.264206 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.264368 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.264459 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.264675 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.264770 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.264999 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.265089 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.265302 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.265390 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.265614 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.265701 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.265948 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.266040 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.266260 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.266349 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.266571 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.266660 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.266886 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.266975 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.267200 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.267330 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.267522 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.267630 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.267834 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.267932 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.268145 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.268242 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.268467 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.268569 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.268800 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.268887 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.269104 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.269427 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.269521 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.269752 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.270082 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.270172 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.270387 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.270654 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.270754 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.270987 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.271234 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.271401 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.271579 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.271799 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.271943 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.272176 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.272384 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.272710 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.272930 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.273077 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.273223 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.273499 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.274140 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.274363 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.274665 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.274753 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.274971 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.275276 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.275359 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.275581 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.275854 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.275973 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.276257 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.276676 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.276773 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.276920 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.277048 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.277234 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.277511 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.277644 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.277825 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.278165 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.278256 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.278521 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.278678 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.278840 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.278930 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.279164 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.279274 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.279478 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.279589 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.279793 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.279894 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.280103 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.280202 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.280417 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.280528 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.280724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.280831 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.281031 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.281131 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.281341 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.281498 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.281661 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.281760 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.281990 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.282106 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.282298 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.282398 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.282604 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.282706 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.282913 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.283028 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.283252 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.283351 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.283579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.283679 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.283885 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.284006 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.284201 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.284308 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.284509 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.284611 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.284819 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.284938 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.285128 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.285226 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.285437 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.285542 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.285757 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.285852 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.286099 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.286225 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.286414 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.286527 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.287274 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.287383 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.287456 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.287603 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.287688 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.287758 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.287833 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.287901 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.288013 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.288507 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.288750 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.288853 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.289067 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.289158 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.289965 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.290066 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.290298 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.290384 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.290638 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.290770 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.290966 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.291076 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.291293 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.291389 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.291607 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.291696 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.291911 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.292004 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.292217 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.292316 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.292527 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.292612 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.292845 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.292938 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.293156 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.293268 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.293466 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.293562 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.293771 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.293874 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.294111 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.294218 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.294420 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.294506 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.294749 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.294849 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.295027 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.295114 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.295339 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.295424 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.295660 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.295746 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.296309 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.297279 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.297279 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.297474 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.297474 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.297628 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.297717 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.297964 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.297964 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.298188 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.298273 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.298351 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.298440 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.298519 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.298598 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.298675 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.298753 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.298844 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.298924 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.299001 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.299085 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.299166 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.299325 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.299448 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.299673 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.299770 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.299943 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.300054 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.300272 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.300392 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.300583 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.300671 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.300989 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.301073 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.301303 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.301402 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.301610 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.301730 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.301954 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.302121 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.302285 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.302425 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.302542 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.302626 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.302844 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.302931 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.303157 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.303289 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.303469 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.303556 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.303781 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.303868 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.304101 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.304186 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.304411 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.304539 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.304716 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.304804 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.305047 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.305141 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.305351 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.305441 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.305664 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.305757 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.306001 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.306116 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.306307 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.306578 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.306673 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.306913 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.307000 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.307230 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.307316 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.307556 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.307642 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.307876 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.308007 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.308201 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.308297 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.308514 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.308608 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.308833 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.308926 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.309148 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.309244 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.309460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.309547 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.309766 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.309889 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.310098 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.310184 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.310403 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.310489 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.310714 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.310813 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.311018 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.311109 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.311324 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.311409 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.311627 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.311714 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.311938 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.312026 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.312240 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.312336 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.312544 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.312645 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.312847 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.312933 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.313152 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.313245 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.313465 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.313550 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.313767 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.313879 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.314234 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.314710 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.314813 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.314897 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.315016 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.315126 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.315321 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.315455 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.315625 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.315790 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.315928 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.316144 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.316275 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.316471 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.316572 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.316811 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.316898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.317146 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.317243 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.317464 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.317566 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.317776 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.317898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.318120 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.318226 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.318431 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.318527 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.318741 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.318827 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.319098 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.319211 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.319356 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.319453 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.319669 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.319755 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.319976 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.320075 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.320277 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.320363 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.320609 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.320694 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.320939 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.321029 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.321258 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.321426 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.321566 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.321652 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.321959 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.322059 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.322281 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.322379 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.322544 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.322635 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.322895 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.322996 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.323209 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.323296 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.323550 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.323644 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.323810 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.324000 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.324188 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.324304 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.324410 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.324502 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.324706 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.324834 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.325015 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.325128 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.325320 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.325478 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.325616 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.325839 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.325965 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.326214 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.326349 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.326569 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.326714 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.326860 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.326990 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.327193 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.327356 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.327503 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.327649 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.327805 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.328034 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.328182 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.328273 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.328410 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.328520 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.328713 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.328815 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.329023 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.329121 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.329325 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.329434 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.329628 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.329728 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.329953 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.330045 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.330273 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.330376 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.330580 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.330670 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.330880 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.330966 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.331183 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.331268 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.331487 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.331571 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.331790 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.331880 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.332096 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.332197 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.332402 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.332501 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.332701 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.332789 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.333004 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.333091 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.333306 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.333399 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.333650 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.333747 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.333932 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.334035 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.334771 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.334876 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.334958 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.335049 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.335132 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.335200 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.335264 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.335328 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.335424 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.335518 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.335748 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.335892 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.336041 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.336615 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.336882 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.336978 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.337197 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.337285 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.337509 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.337637 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.337815 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.337958 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.338149 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.338282 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.338456 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.338551 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.338758 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.338854 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.339063 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.339193 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.339405 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.339491 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.339727 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.339885 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.340029 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.340177 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.340332 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.340440 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.340636 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.340713 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.340943 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.341049 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.341247 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.341323 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.341576 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.341664 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.341900 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.341987 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.342209 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.342312 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.342535 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.342627 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.342844 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.342929 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.343155 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.343311 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.343469 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.343545 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.343779 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.344138 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.344616 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.344714 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.344791 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.344886 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.344953 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.345315 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.345395 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.345477 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.345547 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.345612 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.345684 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.345824 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.346023 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.346248 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.346342 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.346567 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.346666 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.346873 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.346973 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.347178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.347264 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.347491 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.347583 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.347801 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.347901 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.348102 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.348186 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.348409 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.348494 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.348712 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.348806 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.349020 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.349105 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.349323 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.349422 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.349624 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.349756 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.349971 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.350094 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.350287 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.350407 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.350600 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.350713 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.350922 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.351007 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.351339 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.351441 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.351591 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.351680 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.352450 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.352568 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.352767 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.352867 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.353079 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.353176 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.353391 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.353487 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.353701 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.353797 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.354038 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.354142 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.354353 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.354447 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.354668 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.354768 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.354975 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.355136 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.355289 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.355588 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.355911 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.356510 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.356662 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.356806 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.356950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.356950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.357141 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.357232 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.357313 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.357440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.357685 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.357801 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.358023 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.358156 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.358353 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.358463 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.358664 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.358789 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.358969 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.359079 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.359391 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.359509 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.359705 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.359817 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.360018 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.360133 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.360324 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.360436 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.360635 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.360770 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.360947 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.361063 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.361264 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.361376 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.361578 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.361691 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.361907 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.362051 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.362280 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.362688 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.362780 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.362876 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.362959 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.363165 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.363261 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.363482 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.363569 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.363791 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.363884 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.364097 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.364184 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.364409 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.364517 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.364722 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.364809 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.365086 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.365177 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.365351 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.365458 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.365662 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.365827 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.366011 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.366166 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.366299 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.366445 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.366618 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.366744 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.367035 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.367122 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.367374 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.367515 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.367766 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.367871 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.368113 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.368202 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.368427 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.368922 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.369009 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.369091 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.369169 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.369398 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.369501 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.369714 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.369826 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.370126 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.370271 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.370419 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.370560 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.370701 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.370842 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.371009 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.371141 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.371316 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.371445 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.371686 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.371846 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.372006 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.372136 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.372381 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.372522 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.372709 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.372806 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.373021 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.373151 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.373344 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.373472 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.373654 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.373796 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.373989 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.374091 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.374297 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.374390 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.374601 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.374719 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.374950 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.375059 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.375256 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.375386 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.375578 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.375729 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.375917 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.376113 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.376243 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.376422 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.376553 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.376743 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.376893 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.377050 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.377219 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.377380 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.377523 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.377692 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.377838 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.378050 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.378177 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.378334 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.378504 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.378646 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.378808 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.378955 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.379114 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.379262 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.379424 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.379568 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.379728 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.379892 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.380038 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.380187 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.380343 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.380510 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.380651 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.380824 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.381056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.381201 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.381330 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.381448 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.381631 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.381752 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.382041 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.382162 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.382338 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.382414 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.382664 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.382752 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.383006 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.383091 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.383316 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.383400 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.383620 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.383695 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.383923 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.384006 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.384263 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.384387 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.384565 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.384677 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.384892 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.385007 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.385200 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.385314 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.385520 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.385632 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.385842 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.386005 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.386178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.386292 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.386547 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.386681 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.386815 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.386997 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.387114 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.387202 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.387425 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.387519 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.387730 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.387816 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.388039 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.388131 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.388344 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.388442 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.388651 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.388745 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.388958 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.389044 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.389268 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.389513 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.389600 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.389843 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.389951 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.390179 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.390278 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.390494 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.390579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.390797 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.390883 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.391111 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.391205 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.391419 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.391512 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.391725 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.391812 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.392030 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.392195 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.392335 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.392432 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.392645 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.392743 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.392972 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.393060 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.393291 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.393421 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.393617 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.393746 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.393993 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.394083 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.394315 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.394401 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.394636 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.394724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.394954 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.395041 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.395272 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.395373 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.395595 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.395695 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.395916 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.396001 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.396233 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.396328 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.396545 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.396641 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.396865 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.396950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.397182 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.397278 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.397495 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.397601 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.397808 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.398105 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.398192 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.398440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.398539 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.399282 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.399368 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.399603 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.399688 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.400048 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.400224 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.400350 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.400438 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.400562 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.400645 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.400875 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.400978 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.401199 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.401286 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.401516 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.401601 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.401830 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.401989 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.402172 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.402264 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.402500 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.402695 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.402829 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.403009 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.403168 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.403342 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.403491 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.403667 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.403810 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.403995 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.404130 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.404314 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.404448 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.404632 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.404808 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.404958 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.405145 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.405266 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.405488 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.405601 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.405772 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.405885 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.406133 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.406233 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.406451 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.406547 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.406767 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.406854 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.407082 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.407214 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.407388 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.407476 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.407702 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.407787 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.408009 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.408101 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.408319 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.408541 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.408627 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.408891 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.408977 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.409211 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.409349 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.409542 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.409802 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.409947 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.410038 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.410189 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.410282 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.410497 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.410594 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.410826 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.410976 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.411128 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.411345 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.411480 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.411663 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.411803 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.411998 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.412141 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.412312 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.412446 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.412618 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.412752 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.412930 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.413072 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.413502 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.413642 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.413805 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.413957 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.414139 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.414274 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.414983 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.415072 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.415296 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.415381 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.415607 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.415695 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.415908 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.416001 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.416219 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.416314 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.416531 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.416620 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.416835 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.416921 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.417140 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.417236 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.417445 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.417532 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.417748 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.418000 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.418092 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.418351 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.418440 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.418670 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.418757 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.418972 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.419058 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.419333 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.419418 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.419652 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.419760 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.419958 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.420075 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.420289 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.420376 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.420599 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.420697 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.420902 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.420996 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.421219 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.421306 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.421532 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.421635 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.421896 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.421997 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.422224 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.422341 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.422540 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.422625 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.422882 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.422989 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.423196 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.423284 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.423506 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.423590 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.423834 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.424105 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.424200 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.424445 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.424531 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.424748 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.424838 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.425054 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.425149 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.425368 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.425453 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.425672 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.425766 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.426013 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.426104 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.426321 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.426406 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.426647 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.426744 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.426958 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.427043 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.427263 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.427352 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.427573 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.427675 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.427889 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.427987 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.428195 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.428322 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.428506 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.428607 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.428816 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.428980 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.429127 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.429278 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.429437 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.429626 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.429729 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.430011 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.430113 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.430323 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.430501 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.430682 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.430768 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.430995 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.431128 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.431314 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.431422 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.431655 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.431780 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.431976 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.432063 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.432295 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.432390 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.432610 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.432696 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.432926 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.433208 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.433304 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.433531 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.433616 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.433838 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.433986 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.434167 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.434271 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.434483 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.434577 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.434810 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.434908 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.435116 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.435220 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.435420 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.435507 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.435745 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.436091 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.436225 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.436419 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.436562 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.436729 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.436889 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.437040 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.437229 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.437348 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.437528 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.437926 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.438028 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.438099 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.438180 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.438400 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.438683 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.438775 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.438860 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.439021 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.439112 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.439419 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.439533 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.439683 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.439772 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.440090 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.440199 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.440348 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.440436 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.440654 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.440758 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.440963 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.441090 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.441321 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.441414 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.441630 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.441717 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.441969 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.442059 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.442283 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.442376 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.442585 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.442681 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.442889 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.442977 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.443196 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.443290 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.443498 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.443618 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.443801 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.443945 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.444106 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.444276 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.444409 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.444593 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.444717 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.444904 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.445018 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.445323 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.446143 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.446236 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.446496 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.446588 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.446755 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.446842 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.447058 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.447173 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.447368 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.447459 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.447674 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.447835 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.448003 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.448151 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.448286 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.448418 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.448550 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.448689 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.448824 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.448956 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.449160 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.449304 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.449492 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.449635 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.449804 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.449965 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.450149 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.450284 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.450458 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.450601 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.450778 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.450913 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.451085 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.451236 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.451406 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.451543 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.451724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.451867 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.452033 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.452166 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.452338 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.452474 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.452644 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.452777 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.452953 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.453086 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.453261 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.453404 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.453566 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.453700 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.453883 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.454018 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.454187 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.454282 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.454493 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.454602 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.454821 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.454941 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.455123 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.455211 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.455428 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.455515 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.455751 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.455893 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.456069 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.456158 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.456389 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.456478 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.456703 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.456799 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.457017 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.457188 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.457320 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.457407 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.457608 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.457707 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.457943 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.458037 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.458251 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.458337 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.458558 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.458646 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.458867 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.458961 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.459180 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.459275 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.459489 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.459576 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.459798 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.459884 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.460112 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.460205 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.460418 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.460506 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.460741 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.460827 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.461088 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.461762 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.461939 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.462028 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.462253 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.462339 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.462588 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.462687 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.462899 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.462985 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.463210 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.463297 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.463524 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.463619 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.463835 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.463922 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.464142 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.464229 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.464450 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.464545 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.464777 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.464865 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.465021 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 11:56:51.465107 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.465395 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.465717 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.466065 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.466388 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.466702 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.467012 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.467355 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.467649 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.467961 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.468270 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.468582 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.468893 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.469307 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.469548 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.469894 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.470198 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.470514 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.470841 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.471178 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.471491 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.471819 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.472149 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.472498 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.472813 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.473155 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.473482 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.473798 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.474140 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.474447 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:56:51.474692 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 11:56:51.622364 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO dbcounter [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Registered counter for database nova_api Sep 14 11:56:51.631476 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO dbcounter [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Registered counter for database nova_api Sep 14 11:56:51.645807 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_db.sqlalchemy.engines [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 11:56:51.653054 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG oslo_db.sqlalchemy.engines [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 11:56:51.653962 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writer thread running {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 11:56:51.660406 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writer thread running {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 11:56:51.719162 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.context [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e21ce7ae-c7c7-4dea-ab11-eea908a8281e(cell1) {{(pid=106083) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 11:56:51.720259 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.context [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e21ce7ae-c7c7-4dea-ab11-eea908a8281e(cell1) {{(pid=106084) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 11:56:51.723242 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:56:51.723722 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:56:51.724151 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:56:51.724624 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:56:51.725304 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:56:51.726090 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:56:51.726253 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:56:51.726535 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:56:51.727452 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:56:51.727893 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:56:51.729899 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:56:51.730578 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:56:51.731946 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO dbcounter [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Registered counter for database nova_cell0 Sep 14 11:56:51.734138 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO dbcounter [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Registered counter for database nova_cell0 Sep 14 11:56:51.736358 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO dbcounter [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Registered counter for database nova_cell1 Sep 14 11:56:51.738609 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO dbcounter [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Registered counter for database nova_cell1 Sep 14 11:56:51.745133 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_db.sqlalchemy.engines [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 11:56:51.746100 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_db.sqlalchemy.engines [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 11:56:51.747895 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG oslo_db.sqlalchemy.engines [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 11:56:51.750258 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG oslo_db.sqlalchemy.engines [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 11:56:51.753389 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writer thread running {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 11:56:51.754874 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writer thread running {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 11:56:51.755885 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writer thread running {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 11:56:51.757464 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writer thread running {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 11:56:51.902510 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO dbcounter [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Registered counter for database nova_cell0 Sep 14 11:56:51.912400 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_db.sqlalchemy.engines [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 11:56:51.912636 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO dbcounter [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Registered counter for database nova_cell0 Sep 14 11:56:51.918162 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writer thread running {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 11:56:51.922209 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG oslo_db.sqlalchemy.engines [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 11:56:51.927285 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writer thread running {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 11:56:52.364851 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: WARNING keystonemiddleware.auth_token [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 11:56:52.372320 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: WARNING keystonemiddleware.auth_token [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 11:56:52.399876 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: WARNING keystonemiddleware.auth_token [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 11:56:52.407291 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: WARNING keystonemiddleware.auth_token [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 11:56:52.715307 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: WARNING keystonemiddleware.auth_token [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 11:56:52.721118 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: WARNING keystonemiddleware.auth_token [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 11:56:52.726851 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568349ff9c0 pid: 106084 (default app) Sep 14 11:56:52.728911 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:56:52.730112 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Sep 14 11:56:52.730520 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Wed Sep 14 11:56:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:56:52.752186 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: WARNING keystonemiddleware.auth_token [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 11:56:52.758817 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: WARNING keystonemiddleware.auth_token [None req-b1ce4d15-78c1-4705-aefb-ba2d10ceb144 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 11:56:52.764088 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568349ff9c0 pid: 106083 (default app) Sep 14 11:58:20.820668 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:20.821691 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Sep 14 11:58:20.824988 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:58:20.839483 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_api:SELECT=3 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:58:20.840407 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_cell1:SELECT=3 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:58:20.841337 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_cell0:SELECT=3 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:58:20.842101 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:58:21.895873 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-5ac769b6-8330-4c93-83ca-03e09a875ef9 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:21.930593 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-5ac769b6-8330-4c93-83ca-03e09a875ef9 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.101216 Sep 14 11:58:21.931391 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Sep 14 11:58:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:58:24.797997 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:24.799313 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-1097ae1f-5895-429b-9a37-0268c0c17dbe None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001803 Sep 14 11:58:24.800909 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:58:25.338636 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-f8340fe1-7611-438e-a6bf-3ff7d7154bf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "ram": 256, "swap": 0, "vcpus": 1}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:25.436290 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-f8340fe1-7611-438e-a6bf-3ff7d7154bf7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.628408 Sep 14 11:58:25.436783 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 14 11:58:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 11:58:25.455401 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:SELECT=3 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:58:25.456219 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_cell0:SELECT=3 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:58:25.457512 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_cell1:SELECT=3 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:58:25.459192 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:58:25.669149 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-0b75304a-8bf4-4289-9fc9-a3c8af316f5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:25.815924 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-0b75304a-8bf4-4289-9fc9-a3c8af316f5d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.365856 Sep 14 11:58:25.816628 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Sep 14 11:58:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:58:29.056703 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-f8340fe1-7611-438e-a6bf-3ff7d7154bf7 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:29.057632 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-f8340fe1-7611-438e-a6bf-3ff7d7154bf7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 14 11:58:29.058382 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:58:30.146797 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-9ffaac1f-9b8b-47cd-a71b-0531fe8ced05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "swap": 0}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:30.316742 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-9ffaac1f-9b8b-47cd-a71b-0531fe8ced05 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.250793 Sep 14 11:58:30.319156 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 14 11:58:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 11:58:30.337099 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-d74ae216-b4a3-42e5-bded-544b2906b497 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:30.610241 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-d74ae216-b4a3-42e5-bded-544b2906b497 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279509 Sep 14 11:58:30.611501 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Sep 14 11:58:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:58:33.536666 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-9ffaac1f-9b8b-47cd-a71b-0531fe8ced05 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:33.537706 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-9ffaac1f-9b8b-47cd-a71b-0531fe8ced05 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001760 Sep 14 11:58:33.538205 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:58:34.144260 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-c69559b6-b68f-4093-b163-3cf057a1741e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:34.226096 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-c69559b6-b68f-4093-b163-3cf057a1741e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.680839 Sep 14 11:58:34.226674 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 14 11:58:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 11:58:34.243089 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-748b1531-f7c1-4fe9-94e9-c2fbe1c713ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:34.335552 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-748b1531-f7c1-4fe9-94e9-c2fbe1c713ad admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098779 Sep 14 11:58:34.336185 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Sep 14 11:58:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:58:37.390545 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-c69559b6-b68f-4093-b163-3cf057a1741e admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:37.391574 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-c69559b6-b68f-4093-b163-3cf057a1741e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Sep 14 11:58:37.392179 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:58:38.020121 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-58e8702b-a016-4448-b7a5-619bfa4a7c0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:38.123335 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-58e8702b-a016-4448-b7a5-619bfa4a7c0d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.723422 Sep 14 11:58:38.126169 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 14 11:58:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 11:58:38.139780 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-2f776534-7fc0-459a-bf5d-1973ce05c45c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:38.399061 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-2f776534-7fc0-459a-bf5d-1973ce05c45c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.209059 Sep 14 11:58:38.399061 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Sep 14 11:58:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:58:41.354596 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-58e8702b-a016-4448-b7a5-619bfa4a7c0d admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:41.355948 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-58e8702b-a016-4448-b7a5-619bfa4a7c0d admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Sep 14 11:58:41.356538 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 11:58:41.860332 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-7954dc8b-8318-4783-bed4-ba75e1300a1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:41.924669 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-7954dc8b-8318-4783-bed4-ba75e1300a1f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.560332 Sep 14 11:58:41.925246 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 14 11:58:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 11:58:41.938391 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-d2a6c11c-aed1-4fe7-aa08-8221da31e087 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:42.032150 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-d2a6c11c-aed1-4fe7-aa08-8221da31e087 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097395 Sep 14 11:58:42.033114 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Sep 14 11:58:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:58:44.880478 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-7954dc8b-8318-4783-bed4-ba75e1300a1f admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:44.881524 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-7954dc8b-8318-4783-bed4-ba75e1300a1f admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Sep 14 11:58:44.881946 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:58:45.375224 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-0338fcba-646c-4b03-92d3-b004cf2c5dc4 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:45.408543 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-0338fcba-646c-4b03-92d3-b004cf2c5dc4 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.519079 Sep 14 11:58:45.409272 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Sep 14 11:58:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 11:58:48.097648 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-7954dc8b-8318-4783-bed4-ba75e1300a1f admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:48.098713 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-7954dc8b-8318-4783-bed4-ba75e1300a1f admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 14 11:58:48.099126 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:58:48.532461 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-597ca606-4e51-4467-a4d5-237b56950e7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:48.612556 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-597ca606-4e51-4467-a4d5-237b56950e7e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.506520 Sep 14 11:58:48.613378 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 14 11:58:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 11:58:48.625169 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-8070fc7d-3b64-488c-a77e-228f8c6d78eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:48.703842 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-8070fc7d-3b64-488c-a77e-228f8c6d78eb admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082293 Sep 14 11:58:48.721507 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Sep 14 11:58:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 11:58:51.378833 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-597ca606-4e51-4467-a4d5-237b56950e7e admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:51.379846 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-597ca606-4e51-4467-a4d5-237b56950e7e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 14 11:58:51.380247 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:58:51.787633 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-af5ecfb3-fd59-44b9-9b94-44f553c94d38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "id": "2", "vcpus": 1, "name": "m1.small"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:51.795485 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:58:51.865320 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-af5ecfb3-fd59-44b9-9b94-44f553c94d38 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478132 Sep 14 11:58:51.866483 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 14 11:58:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 11:58:51.878405 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-00884538-3700-4d09-8f85-682af10ce238 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:51.967710 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-00884538-3700-4d09-8f85-682af10ce238 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093031 Sep 14 11:58:51.968846 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Sep 14 11:58:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 11:58:54.768017 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-af5ecfb3-fd59-44b9-9b94-44f553c94d38 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:54.768950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-af5ecfb3-fd59-44b9-9b94-44f553c94d38 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 14 11:58:54.769351 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:58:55.249308 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-71c2f612-70fd-448a-9c58-05d827fb4efa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:55.391164 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-71c2f612-70fd-448a-9c58-05d827fb4efa admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.614714 Sep 14 11:58:55.391864 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 14 11:58:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 11:58:55.404885 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-69c83d4d-b3d9-4bba-b8ad-76ac896121a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:55.495990 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-69c83d4d-b3d9-4bba-b8ad-76ac896121a0 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095438 Sep 14 11:58:55.496814 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Sep 14 11:58:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:58:58.303816 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-71c2f612-70fd-448a-9c58-05d827fb4efa admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:58:58.304931 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-71c2f612-70fd-448a-9c58-05d827fb4efa admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 14 11:58:58.305346 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:58:58.835626 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-bd218a52-add5-4c07-9866-f22ac4f0fd40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:58.904738 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-bd218a52-add5-4c07-9866-f22ac4f0fd40 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.592338 Sep 14 11:58:58.906148 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 14 11:58:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 11:58:58.918747 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-46279ed0-8f49-413f-9e5a-d7376f702dd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:58:59.018875 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-46279ed0-8f49-413f-9e5a-d7376f702dd8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103948 Sep 14 11:58:59.019766 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Sep 14 11:58:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:59:01.757936 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-bd218a52-add5-4c07-9866-f22ac4f0fd40 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:01.759083 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-bd218a52-add5-4c07-9866-f22ac4f0fd40 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 14 11:59:01.759570 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:59:02.433702 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-697c6509-2081-4bae-8e48-8203726be4b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "ram": 16384, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:59:02.441432 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:02.570424 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-697c6509-2081-4bae-8e48-8203726be4b7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.803539 Sep 14 11:59:02.571095 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Sep 14 11:59:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 11:59:02.586806 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-8b2f20f6-029b-4a0f-ba28-aba6f065349a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:59:02.691584 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-8b2f20f6-029b-4a0f-ba28-aba6f065349a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111901 Sep 14 11:59:02.692123 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Sep 14 11:59:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 11:59:20.440346 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-697c6509-2081-4bae-8e48-8203726be4b7 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:20.441269 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-697c6509-2081-4bae-8e48-8203726be4b7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 14 11:59:20.441665 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 11:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:59:20.452967 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:20.903490 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-a10dca46-9038-4e73-b0e3-b7a506f2416b admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:20.922853 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-a10dca46-9038-4e73-b0e3-b7a506f2416b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.474261 Sep 14 11:59:20.927549 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Sep 14 11:59:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 11:59:22.250274 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-697c6509-2081-4bae-8e48-8203726be4b7 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:22.251365 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-697c6509-2081-4bae-8e48-8203726be4b7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Sep 14 11:59:22.272796 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 11:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:59:22.776495 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-15913104-a0ba-4cc8-9cc6-0204c02c936b admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:22.781967 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.wsgi [None req-15913104-a0ba-4cc8-9cc6-0204c02c936b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-15913104-a0ba-4cc8-9cc6-0204c02c936b admin admin] Request method failure captured: Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Accept: application/json Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Accept-Encoding: gzip, deflate Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Connection: keep-alive Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Content-Length: 0 Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Host: 10.222.0.62 Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Openstack-Api-Version: compute 2.92 Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Openstack-System-Scope: None Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: User-Agent: python-novaclient Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Auth-Token: gAAAAABjIcIaPYeVbaIYzq33z8lka_gCIGC7lfnP76p0G6AmYM3-8tM9rpZiM4v2jOCJn42qFwaPGmpmrd6fKOf4nRSfyb1E-2bEjWflAztGFM6P-FarI9Cx_WlA9LesbUIhVjOg33bGQaraYRwCQk4_QxYwsQkGenDyucyZqFb0BFjDAic8NsA Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Domain-Id: None Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Domain-Name: None Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Identity-Status: Confirmed Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Is-Admin-Project: True Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Domain-Id: default Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Domain-Name: Default Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Name: admin Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Role: reader,admin,member Sep 14 11:59:22.785457 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Roles: reader,admin,member Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}] Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Tenant: admin Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Tenant-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Tenant-Name: admin Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User: admin Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Domain-Id: default Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Domain-Name: Default Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Id: 6c2df9ec255e48ec9c7b4291f711f0cd Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Name: admin Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: method: > Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: exception: Flavor 42 could not be found. Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: action_args: {'id': '42'} Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 11:59:22.787440 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:22.788340 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:22.789579 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-15913104-a0ba-4cc8-9cc6-0204c02c936b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 11:59:22.790847 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-15913104-a0ba-4cc8-9cc6-0204c02c936b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399229 Sep 14 11:59:22.790847 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Sep 14 11:59:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 11:59:22.797695 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-4c84d996-3a64-49da-a83e-708befb5e7dc admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:22.821388 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-4c84d996-3a64-49da-a83e-708befb5e7dc admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027519 Sep 14 11:59:22.821994 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 14 11:59:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 11:59:22.836021 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-f44547fd-49c0-4da7-8606-2ae060209d09 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:22.858827 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-f44547fd-49c0-4da7-8606-2ae060209d09 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027630 Sep 14 11:59:22.859395 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 14 11:59:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 11:59:22.872061 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-9c01169c-9cbe-44d5-a7f4-8a23f2cd49bd admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:22.876662 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.wsgi [None req-9c01169c-9cbe-44d5-a7f4-8a23f2cd49bd admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-9c01169c-9cbe-44d5-a7f4-8a23f2cd49bd admin admin] Request method failure captured: Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Accept: application/json Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Accept-Encoding: gzip, deflate Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Connection: keep-alive Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Content-Length: 0 Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Host: 10.222.0.62 Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Openstack-Api-Version: compute 2.92 Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Openstack-System-Scope: None Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: User-Agent: python-novaclient Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Auth-Token: gAAAAABjIcIaPYeVbaIYzq33z8lka_gCIGC7lfnP76p0G6AmYM3-8tM9rpZiM4v2jOCJn42qFwaPGmpmrd6fKOf4nRSfyb1E-2bEjWflAztGFM6P-FarI9Cx_WlA9LesbUIhVjOg33bGQaraYRwCQk4_QxYwsQkGenDyucyZqFb0BFjDAic8NsA Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Domain-Id: None Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Domain-Name: None Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Identity-Status: Confirmed Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Is-Admin-Project: True Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Domain-Id: default Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Domain-Name: Default Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Name: admin Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Role: reader,admin,member Sep 14 11:59:22.880178 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Roles: reader,admin,member Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}] Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Tenant: admin Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Tenant-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Tenant-Name: admin Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User: admin Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Domain-Id: default Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Domain-Name: Default Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Id: 6c2df9ec255e48ec9c7b4291f711f0cd Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Name: admin Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: method: > Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: exception: Flavor 42 could not be found. Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: action_args: {'id': '42'} Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 11:59:22.881529 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:22.882439 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:22.883937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-9c01169c-9cbe-44d5-a7f4-8a23f2cd49bd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 11:59:22.884947 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-9c01169c-9cbe-44d5-a7f4-8a23f2cd49bd admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015738 Sep 14 11:59:22.884947 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Sep 14 11:59:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 14 11:59:24.122761 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-f44547fd-49c0-4da7-8606-2ae060209d09 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:24.123781 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-f44547fd-49c0-4da7-8606-2ae060209d09 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 14 11:59:24.124175 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 11:59:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:59:24.655963 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-8acd84bd-1bcd-4a6f-8b3b-83c09dabfe72 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:24.661940 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.wsgi [None req-8acd84bd-1bcd-4a6f-8b3b-83c09dabfe72 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-8acd84bd-1bcd-4a6f-8b3b-83c09dabfe72 admin admin] Request method failure captured: Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Accept: application/json Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Accept-Encoding: gzip, deflate Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Connection: keep-alive Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Content-Length: 0 Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Host: 10.222.0.62 Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Openstack-Api-Version: compute 2.92 Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Openstack-System-Scope: None Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: User-Agent: python-novaclient Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Auth-Token: gAAAAABjIcIcMrUB6ZSCMuK6Ju3EF3TWgaZbHyz55-3Lpkb_omrM1YyYSdgIjSWRwUCmQFos_mtjbNyO1TRtP9wmoDl7GfTv6BHEQUuT0_9w-mZBbEAPS3LsJfnD27ens-1QY62tK7FB986h2wVzmAhATkF7T_z0cRRPnTGn2E894UUZ4QGOMwE Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Domain-Id: None Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Domain-Name: None Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Identity-Status: Confirmed Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Is-Admin-Project: True Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Domain-Id: default Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Domain-Name: Default Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Name: admin Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Role: reader,admin,member Sep 14 11:59:24.663463 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Roles: reader,admin,member Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}] Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Tenant: admin Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Tenant-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Tenant-Name: admin Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User: admin Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Domain-Id: default Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Domain-Name: Default Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Id: 6c2df9ec255e48ec9c7b4291f711f0cd Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Name: admin Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: method: > Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: exception: Flavor 84 could not be found. Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: action_args: {'id': '84'} Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 11:59:24.664925 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:24.665898 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:24.666982 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-8acd84bd-1bcd-4a6f-8b3b-83c09dabfe72 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 11:59:24.668102 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-8acd84bd-1bcd-4a6f-8b3b-83c09dabfe72 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.404536 Sep 14 11:59:24.668102 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Sep 14 11:59:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 11:59:24.674809 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-2e259ad5-b9d1-4aba-8fd7-fe7d4e44377a admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:24.690310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-2e259ad5-b9d1-4aba-8fd7-fe7d4e44377a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019059 Sep 14 11:59:24.690881 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 14 11:59:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 11:59:24.700681 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-4affde77-d9ca-43f7-9fd2-b7472a306108 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:24.716526 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-4affde77-d9ca-43f7-9fd2-b7472a306108 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019609 Sep 14 11:59:24.717063 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 14 11:59:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 11:59:24.727131 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-08ee2a17-0a8a-46ab-8ec3-a2892721cdcd admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:24.732175 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.wsgi [None req-08ee2a17-0a8a-46ab-8ec3-a2892721cdcd admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-08ee2a17-0a8a-46ab-8ec3-a2892721cdcd admin admin] Request method failure captured: Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Accept: application/json Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Accept-Encoding: gzip, deflate Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Connection: keep-alive Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Content-Length: 0 Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Host: 10.222.0.62 Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Openstack-Api-Version: compute 2.92 Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Openstack-System-Scope: None Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: User-Agent: python-novaclient Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Auth-Token: gAAAAABjIcIcMrUB6ZSCMuK6Ju3EF3TWgaZbHyz55-3Lpkb_omrM1YyYSdgIjSWRwUCmQFos_mtjbNyO1TRtP9wmoDl7GfTv6BHEQUuT0_9w-mZBbEAPS3LsJfnD27ens-1QY62tK7FB986h2wVzmAhATkF7T_z0cRRPnTGn2E894UUZ4QGOMwE Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Domain-Id: None Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Domain-Name: None Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Identity-Status: Confirmed Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Is-Admin-Project: True Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Domain-Id: default Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Domain-Name: Default Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Name: admin Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Role: reader,admin,member Sep 14 11:59:24.733666 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Roles: reader,admin,member Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}] Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Tenant: admin Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Tenant-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Tenant-Name: admin Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User: admin Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Domain-Id: default Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Domain-Name: Default Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Id: 6c2df9ec255e48ec9c7b4291f711f0cd Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Name: admin Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: method: > Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: exception: Flavor 84 could not be found. Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: action_args: {'id': '84'} Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 11:59:24.735161 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:24.735950 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:24.737117 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-08ee2a17-0a8a-46ab-8ec3-a2892721cdcd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 11:59:24.738124 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-08ee2a17-0a8a-46ab-8ec3-a2892721cdcd admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012178 Sep 14 11:59:24.738124 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Sep 14 11:59:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 11:59:25.960248 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-4affde77-d9ca-43f7-9fd2-b7472a306108 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:25.961280 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-4affde77-d9ca-43f7-9fd2-b7472a306108 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 14 11:59:25.961674 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 11:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:59:26.494095 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-817b8555-f904-418d-bd0b-49792b868020 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:26.500385 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.wsgi [None req-817b8555-f904-418d-bd0b-49792b868020 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-817b8555-f904-418d-bd0b-49792b868020 admin admin] Request method failure captured: Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Accept: application/json Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Accept-Encoding: gzip, deflate Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Connection: keep-alive Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Content-Length: 0 Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Host: 10.222.0.62 Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Openstack-Api-Version: compute 2.92 Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Openstack-System-Scope: None Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: User-Agent: python-novaclient Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Auth-Token: gAAAAABjIcId2qbDGqgqtZUNxP1tvXJ9lChejLj0_CFLGRnH5WiflQN7IzF6YeCEp5zziRhfInesQvEzo32MGdh4ounHjK9Hnv-jwrv0DOhqHYX6fvcYLBVNN8wW3LxcRs5r4pEUMwyXJz31dtlM53OPznZo6kA60GUlyjg3dVu7qQI5T8dbvEI Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Domain-Id: None Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Domain-Name: None Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Identity-Status: Confirmed Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Is-Admin-Project: True Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Domain-Id: default Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Domain-Name: Default Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Project-Name: admin Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Role: reader,admin,member Sep 14 11:59:26.501952 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Roles: reader,admin,member Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}] Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Tenant: admin Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Tenant-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-Tenant-Name: admin Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User: admin Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Domain-Id: default Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Domain-Name: Default Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Id: 6c2df9ec255e48ec9c7b4291f711f0cd Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: X-User-Name: admin Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: method: > Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: exception: Flavor 451 could not be found. Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: action_args: {'id': '451'} Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 11:59:26.503533 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:26.504460 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 14 11:59:26.506310 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-817b8555-f904-418d-bd0b-49792b868020 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 11:59:26.507671 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-817b8555-f904-418d-bd0b-49792b868020 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.404814 Sep 14 11:59:26.507671 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 14 11:59:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 14 11:59:26.513975 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-0e86d8f8-1f21-4755-ac49-5d5d8e269015 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:26.529347 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-0e86d8f8-1f21-4755-ac49-5d5d8e269015 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019051 Sep 14 11:59:26.529884 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 14 11:59:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 11:59:26.539807 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:26.555288 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019181 Sep 14 11:59:26.555827 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Sep 14 11:59:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 11:59:26.565425 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-571f4af8-c99a-49b9-ba1e-605b613ee666 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:26.570966 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.wsgi [None req-571f4af8-c99a-49b9-ba1e-605b613ee666 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-571f4af8-c99a-49b9-ba1e-605b613ee666 admin admin] Request method failure captured: Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Accept: application/json Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Accept-Encoding: gzip, deflate Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Connection: keep-alive Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Content-Length: 0 Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Host: 10.222.0.62 Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Openstack-Api-Version: compute 2.92 Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Openstack-System-Scope: None Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: User-Agent: python-novaclient Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Auth-Token: gAAAAABjIcId2qbDGqgqtZUNxP1tvXJ9lChejLj0_CFLGRnH5WiflQN7IzF6YeCEp5zziRhfInesQvEzo32MGdh4ounHjK9Hnv-jwrv0DOhqHYX6fvcYLBVNN8wW3LxcRs5r4pEUMwyXJz31dtlM53OPznZo6kA60GUlyjg3dVu7qQI5T8dbvEI Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Domain-Id: None Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Domain-Name: None Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Identity-Status: Confirmed Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Is-Admin-Project: True Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Domain-Id: default Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Domain-Name: Default Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Project-Name: admin Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Role: reader,admin,member Sep 14 11:59:26.572554 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Roles: reader,admin,member Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a95d34dd28804fc3b45b9488a19047b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a95d34dd28804fc3b45b9488a19047b4"}]}] Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Tenant: admin Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Tenant-Id: a95d34dd28804fc3b45b9488a19047b4 Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-Tenant-Name: admin Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User: admin Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Domain-Id: default Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Domain-Name: Default Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Id: 6c2df9ec255e48ec9c7b4291f711f0cd Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: X-User-Name: admin Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: method: > Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: exception: Flavor 451 could not be found. Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: action_args: {'id': '451'} Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 11:59:26.573937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:26.574724 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 14 11:59:26.576056 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-571f4af8-c99a-49b9-ba1e-605b613ee666 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 11:59:26.577271 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-571f4af8-c99a-49b9-ba1e-605b613ee666 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012116 Sep 14 11:59:26.577271 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 14 11:59:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 11:59:27.822542 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:27.823554 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 14 11:59:27.823944 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 11:59:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:59:28.362409 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-181d3c11-16ec-4de5-b63b-6e54a2f81c53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:59:28.453234 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-181d3c11-16ec-4de5-b63b-6e54a2f81c53 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.493573 Sep 14 11:59:28.453777 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Sep 14 11:59:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 11:59:29.748686 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:29.749823 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Sep 14 11:59:29.750252 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 11:59:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:59:30.294923 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-1a815eec-d2e9-4a56-9c71-1c48ee302fcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:59:30.372577 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-1a815eec-d2e9-4a56-9c71-1c48ee302fcf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.482616 Sep 14 11:59:30.373149 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Sep 14 11:59:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 11:59:31.613578 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:31.615409 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002519 Sep 14 11:59:31.616074 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 11:59:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:59:32.149316 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-421d24d9-7f80-40e4-a90d-6bd4500f284b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:59:32.235783 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-421d24d9-7f80-40e4-a90d-6bd4500f284b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.482228 Sep 14 11:59:32.236322 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Sep 14 11:59:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 11:59:33.474096 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:33.475114 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Sep 14 11:59:33.475505 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 11:59:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:59:34.067839 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-6d3edd12-1d2e-496f-b794-26424f4c72c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:59:34.155378 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-6d3edd12-1d2e-496f-b794-26424f4c72c4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.542435 Sep 14 11:59:34.155937 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Sep 14 11:59:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 11:59:35.396152 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:35.397163 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002016 Sep 14 11:59:35.397559 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 11:59:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:59:35.971166 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-40a05495-f889-4fcd-b6e6-b3552539ab85 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:59:35.992470 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-40a05495-f889-4fcd-b6e6-b3552539ab85 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.458002 Sep 14 11:59:35.993019 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Wed Sep 14 11:59:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:00:34.462112 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:00:34.463054 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-712baebd-4bae-443b-940a-153dfc438eac admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 14 12:00:34.463459 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 931 bytes} [Wed Sep 14 12:00:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:00:34.475449 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:34.883203 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-afd67f52-d258-4cea-8c66-9db56c0baebc admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:00:34.904302 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-afd67f52-d258-4cea-8c66-9db56c0baebc admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.433829 Sep 14 12:00:34.904980 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Sep 14 12:00:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:00:34.933444 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-9370abaa-23a9-412a-b329-aa8141dd07bc admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:00:34.937336 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_api:SELECT=14 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:34.942913 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-9370abaa-23a9-412a-b329-aa8141dd07bc admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016300 Sep 14 12:00:34.943472 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1283 bytes} [Wed Sep 14 12:00:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:00:34.955726 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-76a108ab-5469-4dc8-b569-b56103b5c304 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:00:34.963493 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-76a108ab-5469-4dc8-b569-b56103b5c304 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011603 Sep 14 12:00:34.964102 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1286 bytes} [Wed Sep 14 12:00:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:00:34.976486 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-a7498281-a5f7-45e0-a6f1-d98fb4465971 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:00:34.987200 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-a7498281-a5f7-45e0-a6f1-d98fb4465971 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014340 Sep 14 12:00:34.988731 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1286 bytes} [Wed Sep 14 12:00:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:00:34.999478 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-c02c3055-8db9-4e18-b813-cd82d07cbed3 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:00:35.015077 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-c02c3055-8db9-4e18-b813-cd82d07cbed3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019138 Sep 14 12:00:35.015632 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1283 bytes} [Wed Sep 14 12:00:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:03:52.991137 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-a7498281-a5f7-45e0-a6f1-d98fb4465971 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:03:52.992205 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-a7498281-a5f7-45e0-a6f1-d98fb4465971 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 14 12:03:52.992594 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 12:03:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:03:53.132287 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:SELECT=6 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:03:53.272535 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-0afb644e-ee79-4227-af61-ce380cef3dac admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:03:53.277172 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0afb644e-ee79-4227-af61-ce380cef3dac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:03:53.277644 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0afb644e-ee79-4227-af61-ce380cef3dac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:03:53.278090 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0afb644e-ee79-4227-af61-ce380cef3dac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:03:53.278797 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0afb644e-ee79-4227-af61-ce380cef3dac admin admin] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:03:53.279490 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0afb644e-ee79-4227-af61-ce380cef3dac admin admin] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:03:53.279904 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0afb644e-ee79-4227-af61-ce380cef3dac admin admin] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:03:53.311563 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-0afb644e-ee79-4227-af61-ce380cef3dac admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.180377 Sep 14 12:03:53.312116 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 14 12:03:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:03:54.405873 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-a7498281-a5f7-45e0-a6f1-d98fb4465971 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:03:54.406921 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-a7498281-a5f7-45e0-a6f1-d98fb4465971 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 14 12:03:54.407330 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 12:03:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:03:54.597603 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-b622f9fa-9636-46c2-9f30-93418f877de2 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:03:54.601288 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-b622f9fa-9636-46c2-9f30-93418f877de2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:03:54.601833 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-b622f9fa-9636-46c2-9f30-93418f877de2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:03:54.602289 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-b622f9fa-9636-46c2-9f30-93418f877de2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:03:54.603026 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-b622f9fa-9636-46c2-9f30-93418f877de2 admin admin] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:03:54.603468 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-b622f9fa-9636-46c2-9f30-93418f877de2 admin admin] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:03:54.603884 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-b622f9fa-9636-46c2-9f30-93418f877de2 admin admin] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:03:54.623039 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-b622f9fa-9636-46c2-9f30-93418f877de2 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077619 Sep 14 12:03:54.623517 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 14 12:03:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:04:06.155158 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-a7498281-a5f7-45e0-a6f1-d98fb4465971 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:04:06.155663 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-a7498281-a5f7-45e0-a6f1-d98fb4465971 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001726 Sep 14 12:04:06.156609 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 12:04:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:04:06.298888 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_cell0:SELECT=4 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:04:06.299582 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_cell1:SELECT=4 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:04:06.300163 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:SELECT=8 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:04:06.355092 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-e27d2a5b-9d7f-4174-a670-49a82ebca93c admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:04:06.358598 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-e27d2a5b-9d7f-4174-a670-49a82ebca93c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:04:06.359101 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-e27d2a5b-9d7f-4174-a670-49a82ebca93c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:04:06.359532 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-e27d2a5b-9d7f-4174-a670-49a82ebca93c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:04:06.360247 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-e27d2a5b-9d7f-4174-a670-49a82ebca93c admin admin] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:04:06.360696 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-e27d2a5b-9d7f-4174-a670-49a82ebca93c admin admin] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:04:06.361114 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-e27d2a5b-9d7f-4174-a670-49a82ebca93c admin admin] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:04:06.388019 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-e27d2a5b-9d7f-4174-a670-49a82ebca93c admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.093455 Sep 14 12:04:06.389015 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 14 12:04:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:04:07.501808 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-a7498281-a5f7-45e0-a6f1-d98fb4465971 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:04:07.502811 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-a7498281-a5f7-45e0-a6f1-d98fb4465971 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 14 12:04:07.503205 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Sep 14 12:04:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:04:07.697408 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-120cc902-7304-4d6f-9561-baae18c7bee8 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:04:07.700921 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-120cc902-7304-4d6f-9561-baae18c7bee8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:04:07.701394 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-120cc902-7304-4d6f-9561-baae18c7bee8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:04:07.701851 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-120cc902-7304-4d6f-9561-baae18c7bee8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:04:07.702730 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-120cc902-7304-4d6f-9561-baae18c7bee8 admin admin] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:04:07.703171 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-120cc902-7304-4d6f-9561-baae18c7bee8 admin admin] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:04:07.703583 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-120cc902-7304-4d6f-9561-baae18c7bee8 admin admin] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:04:07.727526 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-120cc902-7304-4d6f-9561-baae18c7bee8 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084002 Sep 14 12:04:07.728027 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Sep 14 12:04:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:05:07.776026 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: Wed Sep 14 12:05:07 2022 - graceful shutdown triggered... Sep 14 12:05:07.776095 dv-cinder-844962-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 14 12:05:07.777089 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: Gracefully killing worker 1 (pid: 106083)... Sep 14 12:05:07.777885 dv-cinder-844962-2-iscsi devstack@n-api.service[106084]: Gracefully killing worker 2 (pid: 106084)... Sep 14 12:05:07.903675 dv-cinder-844962-2-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_api:SELECT=4 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:05:08.778200 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: worker 1 buried after 1 seconds Sep 14 12:05:08.778200 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: worker 2 buried after 1 seconds Sep 14 12:05:08.778843 dv-cinder-844962-2-iscsi devstack@n-api.service[106082]: goodbye to uWSGI. Sep 14 12:05:08.779835 dv-cinder-844962-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 14 12:05:08.780401 dv-cinder-844962-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 14 12:05:08.783225 dv-cinder-844962-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 12:05:08.796317 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 12:05:08.798517 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 12:05:08 2022] *** Sep 14 12:05:08.798517 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 12:05:08.798517 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 12:05:08.798517 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: nodename: dv-cinder-844962-2-iscsi Sep 14 12:05:08.798517 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: machine: x86_64 Sep 14 12:05:08.798517 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: clock source: unix Sep 14 12:05:08.798517 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: pcre jit disabled Sep 14 12:05:08.798517 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: detected number of CPU cores: 4 Sep 14 12:05:08.798517 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: current working directory: / Sep 14 12:05:08.798517 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: detected binary path: /usr/bin/uwsgi-core Sep 14 12:05:08.799183 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: your processes number limit is 47680 Sep 14 12:05:08.799183 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: your memory page size is 4096 bytes Sep 14 12:05:08.799183 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: detected max file descriptor number: 2048 Sep 14 12:05:08.799183 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: lock engine: pthread robust mutexes Sep 14 12:05:08.799183 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: thunder lock: enabled Sep 14 12:05:08.799183 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 12:05:08.799183 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 12:05:08.840158 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: Python main interpreter initialized at 0x55ac31e319c0 Sep 14 12:05:08.840158 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: python threads support enabled Sep 14 12:05:08.840158 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: your server socket listen backlog is limited to 100 connections Sep 14 12:05:08.840158 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: your mercy for graceful operations on workers is 90 seconds Sep 14 12:05:08.840599 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 12:05:08.840599 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: *** Operational MODE: preforking *** Sep 14 12:05:08.840884 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: *** uWSGI is running in multiple interpreter mode *** Sep 14 12:05:08.840884 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: spawned uWSGI master process (pid: 121134) Sep 14 12:05:08.841090 dv-cinder-844962-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 14 12:05:08.841990 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: spawned uWSGI worker 1 (pid: 121152, cores: 1) Sep 14 12:05:08.842121 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: spawned uWSGI worker 2 (pid: 121153, cores: 1) Sep 14 12:05:08.842209 dv-cinder-844962-2-iscsi devstack@n-api.service[121134]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 12:05:09.509487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 12:05:09.527924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 12:05:10.678079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 12:05:10.678079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: from cryptography.utils import int_from_bytes Sep 14 12:05:10.678700 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 12:05:10.678700 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: from cryptography.utils import int_from_bytes Sep 14 12:05:10.699649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 12:05:10.699649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: from cryptography.utils import int_from_bytes Sep 14 12:05:10.700425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 12:05:10.700425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: from cryptography.utils import int_from_bytes Sep 14 12:05:13.132867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 12:05:13.133529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 12:05:13.133813 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 12:05:13.134090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 12:05:13.134353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 12:05:13.134752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.135088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.135416 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.135753 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.136092 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.136408 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.136742 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.137069 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.137407 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.137672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.138023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.138584 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844962-2-iscsi {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.138929 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.139248 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.139567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.139898 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.140210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.140540 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.140856 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.141371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.142371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.142966 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.143314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.143703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.144036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.144369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.144715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.145601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.146076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.146586 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.147033 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844962-2-iscsi {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.147497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.147829 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.148158 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.148603 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.148927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.149255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.149746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.150133 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.150452 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.150791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.151121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.151594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.151931 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.152497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.152882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.153186 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.153515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.153847 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.154198 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.154453 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.154770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.155311 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.155729 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.156136 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.156428 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.156684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.157015 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.157366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.157683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.158028 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.158344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.158656 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.158967 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.159278 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.159746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.160062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.160386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.160706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.161575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.161930 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.162258 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.162674 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.162928 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.163240 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.163644 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.163970 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.164282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.164760 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.165118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.165438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.165752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.166146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.166474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.166816 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.167126 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.167381 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.167690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.168053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.168396 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.168707 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.169019 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.169329 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.169675 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.170080 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.170393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.170703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.171011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.171322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.171633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.171943 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.172252 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.172557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.172862 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.173184 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.173509 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.173820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.174155 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.174464 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.174774 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.175096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.175405 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.175718 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.176181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.176435 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.176771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.177596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.178066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.178382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.178704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.179007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.179318 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.179646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.179954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.180266 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.180571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.180877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.181284 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.181593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.181922 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.182235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.182412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 12:05:13.182904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 12:05:13.183049 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.183049 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.183344 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 12:05:13.183489 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.183638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 12:05:13.183792 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.183954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 12:05:13.184114 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.184256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.184407 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.184558 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.184708 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.184858 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.185018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.185172 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.185316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.185490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.185635 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.185812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.186037 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.186187 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.186360 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.186560 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.186730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.186888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.187039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.187190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.187333 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.187475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.187624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.188307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844962-2-iscsi {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.188307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.188610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.188754 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.188896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.189048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.189190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.189340 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.189482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.189624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.189921 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.190087 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.190285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.190605 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.190769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.190769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.191068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.191243 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.191387 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.191387 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.191661 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.191812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.191964 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.192107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.192295 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.192579 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.192730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.192881 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.193035 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.193189 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.193332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.193481 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.193624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.193766 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.193960 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.194112 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.194254 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.194254 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.194541 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844962-2-iscsi {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.194697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.194849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.195000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.195153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.195304 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.195488 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.195656 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.195799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.195951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.196093 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.196241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.196403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.196553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.196696 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.196968 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.197125 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.197268 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.197418 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.197560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.197707 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.197892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.198598 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.198756 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.198914 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.199066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.199225 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.199375 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.199532 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.199684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.199826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.200087 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.200236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.200386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.200386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.200874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.201036 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.201234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.201394 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.201544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.201701 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.201845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.202023 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.202166 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.202317 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.202460 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.202700 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.202862 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.203005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.203165 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.203310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.203467 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.203618 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.203762 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.203910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.204053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.204194 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.204345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.204502 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.204644 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.204785 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.204936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.205093 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.205243 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.205386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.205539 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.205681 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.205830 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.206034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.206187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.206337 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.206488 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.206630 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.206784 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.206946 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.207088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.207237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.207378 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.207519 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.207660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.207809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.207986 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.208150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.208685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.208838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.208991 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.209144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.209294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.209445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.209590 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.209741 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.209915 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.210081 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.210324 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.210481 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.210632 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.210802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.211130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.211290 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.211455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.211606 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.211758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.211901 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.212052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.212203 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.212374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.213149 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.213322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.213469 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.213619 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.213777 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.213777 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.214144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.214297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.214440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.214593 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.214750 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.214894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.215044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.215186 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.215335 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.215492 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.215492 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.215769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.215769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.216071 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.216071 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.216359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.216359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.216638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.216779 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.216920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.217061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.217216 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.217216 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.217495 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.217637 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.217788 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.217953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.218113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.218263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.218870 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.219031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.219175 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.219333 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.219477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.219630 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.219630 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.219917 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.220069 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.220237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.220380 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.220521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.220676 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.220819 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.220819 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.221470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.221470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.221751 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.221975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.222128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.222279 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.222421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.222581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.222581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.222581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.222581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.222581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.222581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.224016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.224202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.224502 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.224657 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.224657 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.224928 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.225084 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.225253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.225408 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.225559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.225701 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.225842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.226022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.226175 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.226326 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.226468 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.226617 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.226767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.226917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.227072 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.227233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.227233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.227523 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.227675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.227826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.227977 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.228118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.228266 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.228417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.228560 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.229163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.229316 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.229470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.229696 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:05:13.229851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.230031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.230187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.230330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.230471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.230629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.230772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.230922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.231074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.231334 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.231687 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.231855 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.231999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.232150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.232311 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.232454 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.232598 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.232739 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.232880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.233030 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.233181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.233323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.233559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.233717 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.233898 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.234076 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.234234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.234384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.234535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.234678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.234828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.234979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.235122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.235122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.235406 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.235557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.235709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.235866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.236018 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.236160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.236308 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.236457 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.236609 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.236752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.236894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.236894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.237161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.237309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.237309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.237600 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.237741 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.237910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.238081 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.238235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.238391 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.238534 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.238683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.238850 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.239885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.240040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.240196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.240340 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.240491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.240640 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.240790 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.240950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.241095 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.241241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.241499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.241850 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.242139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.242355 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.242507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.242650 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.242799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.242952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.243095 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.243246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.243388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.243547 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.243768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.243925 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.244069 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.244227 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.244370 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.244511 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.244662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.244822 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.244974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.245123 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.245266 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.245416 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.245566 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.245708 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.245884 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.246034 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.246176 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.246317 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.246470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.246620 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.246785 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.246929 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.246929 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.247204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.247355 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.247506 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.247727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.247831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.247925 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248018 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248111 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248531 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248616 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248796 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.248963 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249643 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249643 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.249811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.250435 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.250530 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.250530 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.250698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.250794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.250794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.250794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.251093 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.251366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.251481 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.251719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.252030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.252126 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.254668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.254881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.254996 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255175 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255344 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255439 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255525 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255609 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255798 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255883 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.255883 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.256053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.256152 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.256152 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.256152 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.256152 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.256471 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.256563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.256704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.256798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.257085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.257398 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.257665 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.257759 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.258040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.258301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.258407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.258647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.258911 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.259004 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.259396 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.259730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.259824 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.259921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.260118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.260221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.260447 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.260725 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.260825 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.261094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.261431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.261532 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.261776 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.262152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.262262 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.262442 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.262696 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.262796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.263069 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.263289 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.263392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.263725 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.263936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.264047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.264377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.264563 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.264787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.265027 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.265132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.265353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.265651 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.265751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.266008 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.266266 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.266358 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.266661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.266870 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.266985 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.267308 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.267515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.267657 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.268009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.268117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.268313 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.268604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.268695 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.268943 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.269184 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.269291 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.269567 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.269972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.270076 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.270316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.270437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.270708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.270949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.271088 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.271335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.271490 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.271661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.271912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.272075 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.272399 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.272556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.272714 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.272883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.273021 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.273193 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.273511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.273647 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.273899 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.274136 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.274302 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.274517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.274654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.274829 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.275119 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.275276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.275499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.275708 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.275855 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.276115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.276253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.276428 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.276704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.276842 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.277037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.277562 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.277719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.277931 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.278169 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.278327 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.278543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.278682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.278863 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.279133 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.279271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.279470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.279779 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.280133 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.280284 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.280433 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.280433 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.280694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.280852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.281004 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.281153 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.281321 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.281545 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.281682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.282004 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.282158 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.282313 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.282630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.282799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.282951 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.283089 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.283226 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.283461 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.283604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.283810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.284058 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.284196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.284422 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.284576 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.284751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.285045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.285266 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.285407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.285557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.285696 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.286517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.286682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.286841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.287082 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.287240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.287471 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.287610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.287769 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.288049 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.288224 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.288376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.288565 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.288808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.288995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.289150 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.289325 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.289525 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.289665 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.290005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.290387 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.290526 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.290675 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.290814 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.290965 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.291103 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.291254 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.291454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.291757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.291895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.292124 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.292341 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.292482 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.292746 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.292993 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.293153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.293382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.293537 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.293727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.293918 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.294095 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.294368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.294556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.294709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.294904 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.295042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.295346 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.295511 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.295650 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.295861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.295999 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.296223 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.296371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.296535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.296820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.296968 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.297144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.297334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.297487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.297747 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.297936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.298110 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.298341 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.298494 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.299809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.300177 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.300622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.301073 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.301240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.301382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.301521 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.301728 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.302411 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.302652 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.302824 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.302824 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.303347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.303487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.303638 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.303787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.303927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.304065 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.304217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.304417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.304569 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.304708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.304708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.304970 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.305107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.305258 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.305412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.305412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.305793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.305981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.305981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.306264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.306412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.306412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.306686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.306824 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.306961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.307114 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.307114 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.307383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.307529 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.307529 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.307809 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.307961 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.307961 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.307961 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.308444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.308592 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.308746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.308885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.308885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.309161 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.309305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.309443 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.309593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.309732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.309946 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.310292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.310768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.310925 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.311091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.311091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.311366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.311506 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.311506 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.311851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.311992 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.312130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.312282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.312420 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.312556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.312841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.312998 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.313152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.313538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.313684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.313833 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.314027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.314180 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.314320 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.314489 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.314592 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.314935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.315043 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.315208 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.315549 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.315669 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.315911 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.316060 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.316243 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.316343 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.316580 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.316671 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.316892 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.317001 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.317205 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.317327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.317550 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.317645 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.317902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.318018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.318192 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.318349 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.318503 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.318681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.318846 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.319002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.319154 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.319305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.319461 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.319635 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.319872 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.320028 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.320184 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.320546 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.321011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.321011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.321306 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.321450 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.321600 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.321751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.321912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.322087 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.322242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.322393 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.322537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.322679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.322844 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.322844 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.323243 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.323243 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.323758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.323912 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.324054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.324207 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.324361 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.324504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.324646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.324795 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.324938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.325094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.325238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.325380 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.325530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.325674 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.325825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.326123 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.326282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.326436 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.326578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.326719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.326719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.327004 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.327155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.327298 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.327440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.327581 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.327722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.327874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.327874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.328156 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.328309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.328451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.328645 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.328798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.328798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.329089 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.329233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.329381 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.329533 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.329684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.329826 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.330005 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.330162 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.330312 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.330487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.330784 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.331167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.331324 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.331468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.331619 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.331776 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.331921 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.332064 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.332207 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.332358 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.332521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.332665 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.332817 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.332989 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.333223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.333374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.333531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.333699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.334120 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.334284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.334284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.334573 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.334730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.334889 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.335032 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.335182 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.335325 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.335477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.335627 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.335771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.335921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.336089 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.336312 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.336476 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.336620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.336780 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.336932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.337073 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.337215 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.337371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.337524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.337667 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.337809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.337974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.338117 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.338272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.338416 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.338770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.338962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339187 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339389 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339478 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339919 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.339994 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.340065 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.340146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.340233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.340316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.340389 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.340461 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.340678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.340778 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.340901 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.341118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.341218 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.341369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.341622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.341735 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.341819 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.342150 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.342256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.342432 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.342603 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.342766 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.342916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.343077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.343227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.343376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.343620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.343732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.343937 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.344040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.344348 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.344462 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.344684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.344787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.345001 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.345103 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.345336 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.345452 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.345664 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.345785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.346019 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.346359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.346695 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.346885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.347218 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.347329 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.347594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.347708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.347872 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.348005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.348193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.348296 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.349005 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.349164 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.349384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.349533 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.349703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.349850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.350078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.350184 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.350425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.350519 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.350803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.350904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.351134 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.351284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.351483 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.351636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.351823 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.351995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.352155 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.352345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.352523 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.352694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.352854 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.353025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.353194 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.353351 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.353511 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.353701 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.353827 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.354065 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.354187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.354507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.354605 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.354821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.354914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.355136 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.355235 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.355461 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.355565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.355797 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.355905 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.356083 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.356176 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.356399 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.356493 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.356732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.356840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.357045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.357148 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.357379 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.357478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.357698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.357798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.358083 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.358196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.358473 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.358576 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.358792 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.358891 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.359119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.359220 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.359450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.359549 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.359773 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.359871 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.360096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.360198 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.360415 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.360522 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.360739 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.360832 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.361061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.361154 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.361409 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.361512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.361738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.361829 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.362090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.362185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.362424 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.362596 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.362746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.362852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.363065 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.363159 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.363391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.363483 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.363719 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.363812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.364049 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.364171 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.365091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.365205 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.365440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.365558 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.365768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.366058 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.366171 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.366267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.366426 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.366525 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.366753 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.366871 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.367069 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.367163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.367390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.367544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.367706 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.367828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.368017 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.368157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.368336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.368430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.368654 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.368802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.368997 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.369158 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.369308 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.369430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.369641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.369761 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.369998 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.370160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.370327 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.370477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.370623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.370762 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.370937 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.371109 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.371301 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.371437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.371624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.371768 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.371967 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.372132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.372276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.372440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.372599 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.372749 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.372930 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.373094 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.373248 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.373341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.373569 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.373662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.373917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.374018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.374312 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.374472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.374624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.374788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.374980 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.375119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.375215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.375310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.375469 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.375619 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.375805 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.375921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.376192 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.376304 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.376480 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.376726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.376850 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.377072 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.377182 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.377402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.377513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.377730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.377974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.378093 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.378308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.378471 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.378654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.378818 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.378993 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.379127 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.379332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.379466 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.379663 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.379831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.379971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.380098 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.380318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.380450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.380656 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.380797 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.380971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.381103 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.381293 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.381438 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.381612 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.381753 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.381953 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.382097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.382272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.382405 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.382592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.382725 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.382958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.383110 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.383251 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.383390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.383545 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.383685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.383893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.384101 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.384241 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.384462 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.384602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.384789 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.384930 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.385197 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.385347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.385490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.385723 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.385969 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.386104 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.386104 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.386454 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.386454 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.386763 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.386878 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.386987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.387095 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.387221 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.387365 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.387484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.387744 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.387861 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.388062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.388154 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.388402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.388533 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.388694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.388828 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.389042 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.389187 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.389362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.389682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.389968 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.390142 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.390300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.390507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.390733 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.390894 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.391033 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.391170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.391310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.391447 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.391615 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.391749 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.391940 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.392072 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.392256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.392375 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.392570 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.392691 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.392883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.393012 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.393203 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.393327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.393511 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.393640 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.393828 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.393947 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.394278 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.394390 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.394534 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.394674 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.394881 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.395872 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.395992 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.396106 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.396185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.396275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.396275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.397765 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.397960 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398076 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398168 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398439 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398542 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398722 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398807 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398902 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.398995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.399089 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.399176 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.399262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.399354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.399450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.399544 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.399544 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.399701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.399785 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.399877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.400107 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.400456 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.400550 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.400798 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.400984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.401115 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.401433 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.401534 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.401747 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.402313 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.402416 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.402668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.402844 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.402989 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.403199 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.403298 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.403533 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.403641 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.403888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.403988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.404219 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.404313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.404538 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.404714 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.404855 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.404994 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.405157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.405289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.405596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.405744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.406044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.406308 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.406442 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.406645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.406810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.406942 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.407070 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.407206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.407344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.407488 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.407633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.407789 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.407926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.408055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.408190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.408333 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.408471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.408599 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.408734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.408871 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.409007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.409145 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.409274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.409402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.409589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.409723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.409889 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.410036 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.410225 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.410368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.410566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.410700 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.410890 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.411552 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.411732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.411865 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.412155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.412293 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.412480 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.412611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.412832 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.413134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.413275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.413412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.413546 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.413761 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.413922 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.414123 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.414263 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.414459 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.414599 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.414791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.414922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.415112 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.415252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.415431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.415578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.415758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.415899 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.416090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.416256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.416416 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.416638 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.416784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.417025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.417025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.417298 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.417452 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.417600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.417749 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.417952 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.418057 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.418231 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.418403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.418565 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.418730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.418828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.418922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.419019 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.419220 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.419315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.419570 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.419669 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.419893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.420000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.420202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.420318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.420518 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.420623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.420833 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.420942 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.421145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.421238 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.421458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.421558 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.421769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.421892 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.422105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.422208 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.422418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.422520 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.422730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.422831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.423046 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.423139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.423357 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.423450 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.423670 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.423764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.423983 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.424083 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.424303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.424397 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.424614 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.424709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.424954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.425071 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.425341 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.425453 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.425668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.425834 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.426028 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.426196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.426521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.427295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.427534 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.427669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.427806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.427944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.428105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.428252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.428382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.428510 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.428646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.428776 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.428918 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.429048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.429176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.429398 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.429538 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.429756 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.429936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.430127 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.430310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.430451 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.430580 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.430753 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.430895 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.431074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.431217 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.431416 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.431549 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.431735 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.431876 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.432055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.432212 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.432355 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.432466 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.432677 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.432817 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.432994 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.433135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.433317 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.433449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.433636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.433769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.433978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.434121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.434297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.434423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.434641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.434773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.434995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.435127 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.435254 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.435390 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.435565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.435695 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.435882 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.436014 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.436198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.436658 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.436806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.436944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.437083 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.437202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.437202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.437443 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.437443 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.437776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.437947 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.438079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.438214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.438343 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.438468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.438610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.438747 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.438875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.439017 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.439154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.439336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.439476 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.439664 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.439804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.440001 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.440133 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.440331 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.440499 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.440668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.440810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.440980 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.441119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.441256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 12:05:13.441386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.441631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.441984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.442334 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.442682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.443005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.443332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.443658 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.443982 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.444307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.444907 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.445255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.445600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.445942 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.446285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.446621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.446954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.447283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.447629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.447948 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.448268 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.448588 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.448914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.449336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.449547 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.449943 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.450264 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.450540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.450873 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.451202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.451547 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.451888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.452210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.452552 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.452891 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.453254 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.453582 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.453971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.454317 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.454646 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.454972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.455762 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:05:13.455762 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 12:05:13.505254 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO dbcounter [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Registered counter for database nova_api Sep 14 12:05:13.519440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO dbcounter [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Registered counter for database nova_api Sep 14 12:05:13.526005 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_db.sqlalchemy.engines [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 12:05:13.533508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writer thread running {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 12:05:13.542550 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_db.sqlalchemy.engines [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 12:05:13.547256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writer thread running {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 12:05:13.593032 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.context [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e21ce7ae-c7c7-4dea-ab11-eea908a8281e(cell1) {{(pid=121152) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 12:05:13.597159 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:05:13.597647 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:05:13.600123 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:05:13.600941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:05:13.601403 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:05:13.603526 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:05:13.605704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO dbcounter [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Registered counter for database nova_cell0 Sep 14 12:05:13.608052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.context [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e21ce7ae-c7c7-4dea-ab11-eea908a8281e(cell1) {{(pid=121153) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 12:05:13.610268 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO dbcounter [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Registered counter for database nova_cell1 Sep 14 12:05:13.612325 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:05:13.612942 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:05:13.614645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:05:13.615409 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:05:13.615873 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:05:13.617990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_db.sqlalchemy.engines [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 12:05:13.618147 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:05:13.620299 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO dbcounter [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Registered counter for database nova_cell0 Sep 14 12:05:13.620888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_db.sqlalchemy.engines [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 12:05:13.624578 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO dbcounter [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Registered counter for database nova_cell1 Sep 14 12:05:13.627122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writer thread running {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 12:05:13.629808 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writer thread running {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 12:05:13.632338 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_db.sqlalchemy.engines [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 12:05:13.635014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_db.sqlalchemy.engines [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 12:05:13.639553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writer thread running {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 12:05:13.646209 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writer thread running {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 12:05:13.787103 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO dbcounter [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Registered counter for database nova_cell0 Sep 14 12:05:13.794279 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_db.sqlalchemy.engines [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 12:05:13.799145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writer thread running {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 12:05:13.799779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO dbcounter [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Registered counter for database nova_cell0 Sep 14 12:05:13.806777 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_db.sqlalchemy.engines [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 12:05:13.811636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writer thread running {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 12:05:14.124351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: WARNING keystonemiddleware.auth_token [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 12:05:14.132486 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: WARNING keystonemiddleware.auth_token [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 12:05:14.140773 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: WARNING keystonemiddleware.auth_token [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 12:05:14.148891 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: WARNING keystonemiddleware.auth_token [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 12:05:14.483867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: WARNING keystonemiddleware.auth_token [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 12:05:14.490593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: WARNING keystonemiddleware.auth_token [None req-168d065f-4285-46b7-ad10-b35636cd030c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 12:05:14.495997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac31e319c0 pid: 121152 (default app) Sep 14 12:05:14.502508 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: WARNING keystonemiddleware.auth_token [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 12:05:14.509164 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: WARNING keystonemiddleware.auth_token [None req-274f120b-1cae-46d4-b3e4-ffd8a3fe6f98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 12:05:14.514535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac31e319c0 pid: 121153 (default app) Sep 14 12:05:53.053468 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=3 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:05:53.056122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=3 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:05:53.057786 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=3 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:05:53.059449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=3 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:05:53.265645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:05:53.267869 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:05:53.270490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:05:53.271778 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:05:54.180514 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0b561d71-4480-446e-9137-b26ef4cb706a tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Action: 'create', calling method: .version_select at 0x7f1c9ac0b430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1876313771", "metadata": {"Type": "work"}}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0b561d71-4480-446e-9137-b26ef4cb706a tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Request method failure captured: Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 122 Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOgy-ZeRxfi_5WfPUOTdx5AdSrA8uViHaFqu8xmoVj_knsjXzQToWzoW0nKJarEGIMHZ_4tI51sBAQmFt5FXcL93BsBu4uasjYADCCOWga5zyeed1-2wE4poslKIn0xtVbWCx8daP0gB0m4dqisDXuH_VWPspkR2lO0INOL6xh7iOA Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:05:54.187397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}] Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 41195f33c5f74c9bbea21f5fc177e2e5 Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1876313771", "metadata": {"Type": "work"}}} Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: Sep 14 12:05:54.192895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1876313771', 'metadata': {'Type': 'work'}}}} Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise error Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi '#$%' Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:05:54.198434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 12:05:54.202677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 12:05:54.205537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 12:05:54.205537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.205537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0b561d71-4480-446e-9137-b26ef4cb706a tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:05:54.205537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0b561d71-4480-446e-9137-b26ef4cb706a tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.153130 Sep 14 12:05:54.205537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Sep 14 12:05:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 12:05:54.212510 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3df28725-0786-478e-b83e-55c1a49dc4ea tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Action: 'create', calling method: .version_select at 0x7f1c9ac0bd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1871253436", "metadata": {"Type": "work"}}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3df28725-0786-478e-b83e-55c1a49dc4ea tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Request method failure captured: Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 120 Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOgy-ZeRxfi_5WfPUOTdx5AdSrA8uViHaFqu8xmoVj_knsjXzQToWzoW0nKJarEGIMHZ_4tI51sBAQmFt5FXcL93BsBu4uasjYADCCOWga5zyeed1-2wE4poslKIn0xtVbWCx8daP0gB0m4dqisDXuH_VWPspkR2lO0INOL6xh7iOA Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:05:54.219978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}] Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 41195f33c5f74c9bbea21f5fc177e2e5 Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1871253436", "metadata": {"Type": "work"}}} Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: Sep 14 12:05:54.222867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1871253436', 'metadata': {'Type': 'work'}}}} Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise error Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi '0' Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:05:54.224772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 12:05:54.235374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 12:05:54.238384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 12:05:54.238384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.238384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3df28725-0786-478e-b83e-55c1a49dc4ea tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:05:54.238384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3df28725-0786-478e-b83e-55c1a49dc4ea tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021658 Sep 14 12:05:54.238384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 2/2] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Sep 14 12:05:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 12:05:54.239097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2f25bf97-fd91-4adb-9f6d-7102ff999e65 tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Action: 'create', calling method: .version_select at 0x7f1c9aac7160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1841332941", "metadata": {"Type": "work"}}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2f25bf97-fd91-4adb-9f6d-7102ff999e65 tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Request method failure captured: Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 119 Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOgy-ZeRxfi_5WfPUOTdx5AdSrA8uViHaFqu8xmoVj_knsjXzQToWzoW0nKJarEGIMHZ_4tI51sBAQmFt5FXcL93BsBu4uasjYADCCOWga5zyeed1-2wE4poslKIn0xtVbWCx8daP0gB0m4dqisDXuH_VWPspkR2lO0INOL6xh7iOA Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:05:54.243910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}] Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 41195f33c5f74c9bbea21f5fc177e2e5 Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1841332941", "metadata": {"Type": "work"}}} Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: Sep 14 12:05:54.246592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1841332941', 'metadata': {'Type': 'work'}}}} Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise error Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi '' Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:05:54.248234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 12:05:54.256793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 12:05:54.262023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 12:05:54.262023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:54.262023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2f25bf97-fd91-4adb-9f6d-7102ff999e65 tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:05:54.262023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2f25bf97-fd91-4adb-9f6d-7102ff999e65 tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012884 Sep 14 12:05:54.262023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 3/3] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Sep 14 12:05:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 12:05:54.263335 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-78fe3df8-d54f-4455-a851-114552eaa9fe tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Calling method '.version_select at 0x7f1c9aac7b80>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:05:54.716378 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-58fd5de3-95d2-4f03-ae4d-4bcfbd343246 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] Action: 'create', calling method: .version_select at 0x7f1c9ac15700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1200993429", "metadata": {"Type": "work"}}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:05:55.470831 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-78fe3df8-d54f-4455-a851-114552eaa9fe tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] HTTP exception thrown: Volume tempest-invalid-1303656965 could not be found. Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-78fe3df8-d54f-4455-a851-114552eaa9fe tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Request method failure captured: Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1303656965 HTTP/1.1 Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOgy-ZeRxfi_5WfPUOTdx5AdSrA8uViHaFqu8xmoVj_knsjXzQToWzoW0nKJarEGIMHZ_4tI51sBAQmFt5FXcL93BsBu4uasjYADCCOWga5zyeed1-2wE4poslKIn0xtVbWCx8daP0gB0m4dqisDXuH_VWPspkR2lO0INOL6xh7iOA Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:05:55.483060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}] Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 41195f33c5f74c9bbea21f5fc177e2e5 Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Volume tempest-invalid-1303656965 could not be found. Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'tempest-invalid-1303656965'} Sep 14 12:05:55.494393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1303656965 could not be found. (HTTP 404) (Request-ID: req-43777e75-4917-4792-9f54-55a258297254) Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:55.495567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 12:05:55.498972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1303656965 could not be found. Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:05:55.500630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1303656965 could not be found. Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1303656965 could not be found. Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-78fe3df8-d54f-4455-a851-114552eaa9fe tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Returning 404 to user: Volume tempest-invalid-1303656965 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-78fe3df8-d54f-4455-a851-114552eaa9fe tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1303656965" status: 404 len: 99 microversion: 2.1 time: 1.231791 Sep 14 12:05:55.507128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 4/4] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 14 12:05:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1303656965 => generated 99 bytes in 1243 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 12:05:55.512808 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-289b9c39-91f5-4aef-a70e-57b4ca193b7a tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008495 Sep 14 12:05:55.513806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 5/5] 10.222.0.62 () {58 vars in 1140 bytes} [Wed Sep 14 12:05:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 12:05:55.532073 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7f3bafc2-e010-4deb-976e-f3c38c9d6990 tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010540 Sep 14 12:05:55.535126 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 6/6] 10.222.0.62 () {58 vars in 1137 bytes} [Wed Sep 14 12:05:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 12:05:55.547226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5fdb9882-2aaa-4959-8e5c-725791fe9f7b tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Calling method '.version_select at 0x7f1c9aa4ddc0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:05:55.691553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-5fdb9882-2aaa-4959-8e5c-725791fe9f7b tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] HTTP exception thrown: Volume 562797bc-9f2e-428f-b338-e59fdc32e814 could not be found. Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5fdb9882-2aaa-4959-8e5c-725791fe9f7b tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Request method failure captured: Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/os-volumes/562797bc-9f2e-428f-b338-e59fdc32e814 HTTP/1.1 Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOgy-ZeRxfi_5WfPUOTdx5AdSrA8uViHaFqu8xmoVj_knsjXzQToWzoW0nKJarEGIMHZ_4tI51sBAQmFt5FXcL93BsBu4uasjYADCCOWga5zyeed1-2wE4poslKIn0xtVbWCx8daP0gB0m4dqisDXuH_VWPspkR2lO0INOL6xh7iOA Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:05:55.694697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}] Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 41195f33c5f74c9bbea21f5fc177e2e5 Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Volume 562797bc-9f2e-428f-b338-e59fdc32e814 could not be found. Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '562797bc-9f2e-428f-b338-e59fdc32e814'} Sep 14 12:05:55.695734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 562797bc-9f2e-428f-b338-e59fdc32e814 could not be found. (HTTP 404) (Request-ID: req-c271fb59-e586-44cb-b870-88d6d11e6994) Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:55.696519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 12:05:55.702507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 562797bc-9f2e-428f-b338-e59fdc32e814 could not be found. Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 12:05:55.703637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 562797bc-9f2e-428f-b338-e59fdc32e814 could not be found. Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 562797bc-9f2e-428f-b338-e59fdc32e814 could not be found. Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5fdb9882-2aaa-4959-8e5c-725791fe9f7b tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Returning 404 to user: Volume 562797bc-9f2e-428f-b338-e59fdc32e814 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5fdb9882-2aaa-4959-8e5c-725791fe9f7b tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/562797bc-9f2e-428f-b338-e59fdc32e814" status: 404 len: 109 microversion: 2.1 time: 0.158377 Sep 14 12:05:55.706002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 7/7] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 14 12:05:55 2022] DELETE /compute/v2.1/os-volumes/562797bc-9f2e-428f-b338-e59fdc32e814 => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:05:55.718039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-079c2dbe-926a-4a56-8afb-147f7321c088 tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Calling method '.version_select at 0x7f1c9a9fa550>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:05:55.951039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-079c2dbe-926a-4a56-8afb-147f7321c088 tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] HTTP exception thrown: Volume 9a08d860-4648-4c22-aefc-c5f10a016d72 could not be found. Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-079c2dbe-926a-4a56-8afb-147f7321c088 tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Request method failure captured: Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/os-volumes/9a08d860-4648-4c22-aefc-c5f10a016d72 HTTP/1.1 Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOgy-ZeRxfi_5WfPUOTdx5AdSrA8uViHaFqu8xmoVj_knsjXzQToWzoW0nKJarEGIMHZ_4tI51sBAQmFt5FXcL93BsBu4uasjYADCCOWga5zyeed1-2wE4poslKIn0xtVbWCx8daP0gB0m4dqisDXuH_VWPspkR2lO0INOL6xh7iOA Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:05:55.952976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c93eb4d32fd643328949c7edeb3a360d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c93eb4d32fd643328949c7edeb3a360d"}]}] Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: c93eb4d32fd643328949c7edeb3a360d Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesNegativeTest-751993049 Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 41195f33c5f74c9bbea21f5fc177e2e5 Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesNegativeTest-751993049-project Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Volume 9a08d860-4648-4c22-aefc-c5f10a016d72 could not be found. Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '9a08d860-4648-4c22-aefc-c5f10a016d72'} Sep 14 12:05:55.954228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a08d860-4648-4c22-aefc-c5f10a016d72 could not be found. (HTTP 404) (Request-ID: req-888562a1-c441-4299-9cc8-9a3f88f01d0c) Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:55.955036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 12:05:55.956689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a08d860-4648-4c22-aefc-c5f10a016d72 could not be found. Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 12:05:55.957625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a08d860-4648-4c22-aefc-c5f10a016d72 could not be found. Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a08d860-4648-4c22-aefc-c5f10a016d72 could not be found. Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-079c2dbe-926a-4a56-8afb-147f7321c088 tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] Returning 404 to user: Volume 9a08d860-4648-4c22-aefc-c5f10a016d72 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:05:55.959353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-079c2dbe-926a-4a56-8afb-147f7321c088 tempest-VolumesNegativeTest-751993049 tempest-VolumesNegativeTest-751993049-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9a08d860-4648-4c22-aefc-c5f10a016d72" status: 404 len: 109 microversion: 2.1 time: 0.249188 Sep 14 12:05:55.963506 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 8/8] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:05:55 2022] GET /compute/v2.1/os-volumes/9a08d860-4648-4c22-aefc-c5f10a016d72 => generated 109 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:05:56.943309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-58fd5de3-95d2-4f03-ae4d-4bcfbd343246 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.709235 Sep 14 12:05:56.944022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 1/9] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Sep 14 12:05:53 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3716 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 14 12:05:56.959618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-161e64e0-23f6-4e4a-a75f-98c161004b4a tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] Calling method '.version_select at 0x7f1c9aa4db80>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:05:57.070395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-161e64e0-23f6-4e4a-a75f-98c161004b4a tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef" status: 200 len: 353 microversion: 2.1 time: 0.115055 Sep 14 12:05:57.071192 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 9/10] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:05:56 2022] GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:05:58.088058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8ef0fac3-dcbe-4842-bac7-2b41dc0eebe9 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] Calling method '.version_select at 0x7f1c9aae8310>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:05:58.214060 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8ef0fac3-dcbe-4842-bac7-2b41dc0eebe9 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef" status: 200 len: 353 microversion: 2.1 time: 0.131678 Sep 14 12:05:58.214786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 2/11] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:05:58 2022] GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:05:59.234691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9e0958f6-7ab8-45a8-ae8f-dc22615b8c5d tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] Calling method '.version_select at 0x7f1c9a9fa430>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:05:59.357150 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9e0958f6-7ab8-45a8-ae8f-dc22615b8c5d tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef" status: 200 len: 354 microversion: 2.1 time: 0.126368 Sep 14 12:05:59.357702 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 10/12] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:05:59 2022] GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:05:59.371406 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0eb5427d-58e4-40d4-9481-61cb7618436e tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] Calling method '.version_select at 0x7f1c9aae85e0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:05:59.442019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0eb5427d-58e4-40d4-9481-61cb7618436e tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef" status: 200 len: 354 microversion: 2.1 time: 0.074497 Sep 14 12:05:59.448372 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 3/13] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:05:59 2022] GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:05:59.465216 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2926465e-6ddb-4c69-8701-84c42007b526 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] Calling method '.version_select at 0x7f1c9aa06040>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:05:59.743164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2926465e-6ddb-4c69-8701-84c42007b526 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef" status: 202 len: 0 microversion: 2.1 time: 0.281808 Sep 14 12:05:59.743994 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 11/14] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 14 12:05:59 2022] DELETE /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:05:59.757088 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a1988cdd-9821-4a5d-acbe-22962a6b73e0 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] Calling method '.version_select at 0x7f1c9aae8af0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:05:59.916736 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a1988cdd-9821-4a5d-acbe-22962a6b73e0 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef" status: 200 len: 353 microversion: 2.1 time: 0.167354 Sep 14 12:05:59.917515 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 4/15] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:05:59 2022] GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:06:00.935727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5589ecce-54dd-4e76-8987-577d1a8beb51 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] Calling method '.version_select at 0x7f1c9a9fa430>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:01.004256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-5589ecce-54dd-4e76-8987-577d1a8beb51 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] HTTP exception thrown: Volume f4629613-49ef-4ec4-9279-8a1ef06c6fef could not be found. Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5589ecce-54dd-4e76-8987-577d1a8beb51 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] Request method failure captured: Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef HTTP/1.1 Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOhk2CVCn0ZV1KxAaEqC2U5F8HK4CDXrqjFPAD_DGR7eU6eJRsOk64J1tw_A07FU5bXg8kkcnwSxy15R6_TeiL6P015nCs4-fpxHts7h736hj1sbjkTo4lC31yyXhaCM6aEcs2QlAMaQnPJKZgM-muKRpqfexlPAKsD0Bl_hZTKz4A Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: efcd7551351e41f7895b38ca6ad7271b Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesGetTestJSON-1826179844 Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:06:01.004608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/efcd7551351e41f7895b38ca6ad7271b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/efcd7551351e41f7895b38ca6ad7271b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_efcd7551351e41f7895b38ca6ad7271b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/efcd7551351e41f7895b38ca6ad7271b"}]}] Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesGetTestJSON-1826179844 Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: efcd7551351e41f7895b38ca6ad7271b Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesGetTestJSON-1826179844 Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesGetTestJSON-1826179844-project Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 91ca8b5941a84fa580672dea3d78a9b9 Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesGetTestJSON-1826179844-project Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Volume f4629613-49ef-4ec4-9279-8a1ef06c6fef could not be found. Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'f4629613-49ef-4ec4-9279-8a1ef06c6fef'} Sep 14 12:06:01.006074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4629613-49ef-4ec4-9279-8a1ef06c6fef could not be found. (HTTP 404) (Request-ID: req-c183b021-d7df-4040-bb82-84a08478c202) Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:06:01.010146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 12:06:01.011519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4629613-49ef-4ec4-9279-8a1ef06c6fef could not be found. Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 12:06:01.012653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4629613-49ef-4ec4-9279-8a1ef06c6fef could not be found. Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4629613-49ef-4ec4-9279-8a1ef06c6fef could not be found. Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5589ecce-54dd-4e76-8987-577d1a8beb51 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] Returning 404 to user: Volume f4629613-49ef-4ec4-9279-8a1ef06c6fef could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5589ecce-54dd-4e76-8987-577d1a8beb51 tempest-VolumesGetTestJSON-1826179844 tempest-VolumesGetTestJSON-1826179844-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef" status: 404 len: 109 microversion: 2.1 time: 0.078071 Sep 14 12:06:01.013759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 12/16] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:06:00 2022] GET /compute/v2.1/os-volumes/f4629613-49ef-4ec4-9279-8a1ef06c6fef => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:06:09.115988 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b4ce332b-bc9b-4764-96d2-bdb1b78addb7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Action: 'create', calling method: .version_select at 0x7f1c9aa7e0d0>, body: {"keypair": {"name": "tempest-keypair-831008875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjrnEJbjIF2EclxzR93zyAW8uGf477gvb4NcbfPHl4QYfpuQetcOjcGr56a6Xwkd7HF3oDrm6cSDzv/3vnbrpUyCimZlsAqs9RSQfUDdpnbhH7G8msu4Ma+gWsUDTygtA=="}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:09.260431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-b4ce332b-bc9b-4764-96d2-bdb1b78addb7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Getting quotas for project d410170ed3ed4ce2b64d367cbf77790a. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:06:09.269367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-b4ce332b-bc9b-4764-96d2-bdb1b78addb7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Getting quotas for user 28e44067e07d4501a840108f4dcf053c and project d410170ed3ed4ce2b64d367cbf77790a. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:06:09.504783 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b4ce332b-bc9b-4764-96d2-bdb1b78addb7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.751647 Sep 14 12:06:09.506951 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 5/17] 10.222.0.62 () {62 vars in 1200 bytes} [Wed Sep 14 12:06:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 755 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 12:06:12.263803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-524976258", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "networks": [{"uuid": "e96091d1-99a1-47fc-9c36-d9d9004c432f"}]}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:12.609403 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.network.neutron [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] validate_networks() for [('e96091d1-99a1-47fc-9c36-d9d9004c432f', None, None, None, None, None)] {{(pid=121152) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:06:12.920839 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-eb847e85-91ce-4dd0-8e0d-65553b25a825 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'create', calling method: .version_select at 0x7f1c9aa5c160>, body: {"keypair": {"name": "tempest-keypair-617850249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUx+XuqmpW/J/iUOTgNoZaABdG0Zo7REeDIOUsAGB2HxVwgoBjSCDrzB1tEYpD+wB+XLjq/iUsqVj6ZweipzmZ+83Ykk9njtNkY9MDqV8SfMfUZMJpMBq/xRggGK1Qp3Q=="}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:12.963579 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-eb847e85-91ce-4dd0-8e0d-65553b25a825 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Getting quotas for project e35c2ab9a9644cadadd4da9a544b944b. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:06:12.985496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-eb847e85-91ce-4dd0-8e0d-65553b25a825 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Getting quotas for user 2ba1860ce5504c27816a504776463d9c and project e35c2ab9a9644cadadd4da9a544b944b. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:06:13.121271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-eb847e85-91ce-4dd0-8e0d-65553b25a825 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.357953 Sep 14 12:06:13.122384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 6/18] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 14 12:06:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:06:13.230717 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1945683672", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:13.504631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] validate_networks() for [('644a779f-cf29-481b-810a-522abcbb7388', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:06:14.527227 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Flavor limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:06:14.530376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Image limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:06:14.530376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Flavor pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:06:14.530376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Image pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:06:14.530376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:06:14.570797 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:14.572371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:14.572832 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:14.573593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:14.576540 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:14.576875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:14.627254 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Getting quotas for project 933ef2ab34a441b982b69839434d689e. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:06:14.660332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Getting quotas for user 5d6b6321705947b6a395f77c11b1c6a5 and project 933ef2ab34a441b982b69839434d689e. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:06:14.710631 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Going to run 1 instances... {{(pid=121152) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:06:14.715997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:06:14.949487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:06:14.950070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:06:14.950513 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:06:14.950994 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:06:14.951415 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:06:14.969795 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:14.970310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:14.970760 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:14.971544 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:14.972082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:14.972507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:14.974106 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-befad7df-0d91-4e4e-ba1c-fc46d171fa80 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.982695 Sep 14 12:06:14.977234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 13/19] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:06:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:06:14.991591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fb4fe11a-cf5b-448b-a516-c7c3c2119c2c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:14.992220 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-fb4fe11a-cf5b-448b-a516-c7c3c2119c2c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:15.043371 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Getting quotas for project 748b7c08460b4f718dfff67275d8e4e4. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:06:15.054652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Getting quotas for user 4bd4125ff6bb400bae1b94df7d2cfa17 and project 748b7c08460b4f718dfff67275d8e4e4. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:06:15.077915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:06:15.081493 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:06:15.242854 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fb4fe11a-cf5b-448b-a516-c7c3c2119c2c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:15.308029 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-fb4fe11a-cf5b-448b-a516-c7c3c2119c2c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1214 microversion: 2.1 time: 0.322496 Sep 14 12:06:15.313106 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 14/20] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:14 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:15.347177 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1034306873", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ca6a8c3-1298-4a9f-a110-741bf377213f"}], "security_groups": [{"name": "tempest-securitygroup--564643965"}], "key_name": "tempest-keypair-831008875", "user_data": "}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:15.350233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c6be2f1d-4fde-4f93-b19c-c57a22d58dfd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.226498 Sep 14 12:06:15.360699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 7/21] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:06:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:06:15.367780 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-50eafde7-6682-4c13-a1e3-15ce475a56fa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:15.368832 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-50eafde7-6682-4c13-a1e3-15ce475a56fa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:15.579264 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-50eafde7-6682-4c13-a1e3-15ce475a56fa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:15.590560 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-50eafde7-6682-4c13-a1e3-15ce475a56fa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1222 microversion: 2.1 time: 0.226182 Sep 14 12:06:15.623494 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 8/22] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:15 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1222 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:15.666209 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.network.neutron [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] validate_networks() for [('0ca6a8c3-1298-4a9f-a110-741bf377213f', None, None, None, None, None)] {{(pid=121152) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:06:15.874068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-166611587", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:15.992712 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] validate_networks() for [('644a779f-cf29-481b-810a-522abcbb7388', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:06:17.418834 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Flavor limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:06:17.419375 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Image limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:06:17.419774 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Flavor pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:06:17.420516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Image pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:06:17.421235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:06:17.436724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:17.436724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:17.438467 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:17.439752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:17.440524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:17.441061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:17.466368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Getting quotas for project d410170ed3ed4ce2b64d367cbf77790a. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:06:17.473030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Getting quotas for user 28e44067e07d4501a840108f4dcf053c and project d410170ed3ed4ce2b64d367cbf77790a. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:06:17.487340 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:06:17.487916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:06:17.488383 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:06:17.488935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:06:17.489352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:06:17.493826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Going to run 1 instances... {{(pid=121152) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:06:17.497076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:06:17.500429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:17.500966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:17.501414 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:17.502203 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:17.502670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:17.503103 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:17.549435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Getting quotas for project 748b7c08460b4f718dfff67275d8e4e4. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:06:17.561122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Getting quotas for user 4bd4125ff6bb400bae1b94df7d2cfa17 and project 748b7c08460b4f718dfff67275d8e4e4. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:06:17.597996 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:06:17.597996 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:06:17.798190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2dbd406f-099f-49ad-8524-eec39f09c7a9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.482038 Sep 14 12:06:17.800516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 15/23] 10.222.0.62 () {62 vars in 1188 bytes} [Wed Sep 14 12:06:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 2487 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 12:06:17.815944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e4b89560-7a8a-4c4e-9651-e6871c55f6f6 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:17.817793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e4b89560-7a8a-4c4e-9651-e6871c55f6f6 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:17.871832 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-40f317e7-7aeb-4fa7-9b77-a87bbc0fbe2a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.003026 Sep 14 12:06:17.894624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 9/24] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:06:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:06:17.895376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2b8cd21b-6761-40a5-a696-97015a59851a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:17.895757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2b8cd21b-6761-40a5-a696-97015a59851a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:18.060199 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e4b89560-7a8a-4c4e-9651-e6871c55f6f6 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:18.069510 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e4b89560-7a8a-4c4e-9651-e6871c55f6f6 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1214 microversion: 2.1 time: 0.266836 Sep 14 12:06:18.087770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 16/25] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:17 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1214 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:18.103009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2b8cd21b-6761-40a5-a696-97015a59851a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:18.108380 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2b8cd21b-6761-40a5-a696-97015a59851a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:18.116326 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2b8cd21b-6761-40a5-a696-97015a59851a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:18.117195 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-dbb29a06-0b9d-458c-bf9c-bbbbcdfc2534 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:18.117505 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2b8cd21b-6761-40a5-a696-97015a59851a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1281 microversion: 2.20 time: 0.230041 Sep 14 12:06:18.120468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 10/26] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:17 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1281 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:18.123021 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-dbb29a06-0b9d-458c-bf9c-bbbbcdfc2534 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:18.292601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-dbb29a06-0b9d-458c-bf9c-bbbbcdfc2534 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:18.306136 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-dbb29a06-0b9d-458c-bf9c-bbbbcdfc2534 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1221 microversion: 2.1 time: 0.210759 Sep 14 12:06:18.306720 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 17/27] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:18 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1221 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:19.111408 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9143c43f-b989-4ee3-91bf-38f1cb25c546 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:19.114087 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1764357599", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f06a80ac-04e5-4ae1-9b24-c817b700ac9e"}], "security_groups": [{"name": "tempest-securitygroup--1612821863"}], "key_name": "tempest-keypair-617850249", "user_data": "}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:19.115270 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9143c43f-b989-4ee3-91bf-38f1cb25c546 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:19.125053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9143c43f-b989-4ee3-91bf-38f1cb25c546 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:19.126273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9143c43f-b989-4ee3-91bf-38f1cb25c546 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:19.127056 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9143c43f-b989-4ee3-91bf-38f1cb25c546 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:19.128547 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9143c43f-b989-4ee3-91bf-38f1cb25c546 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:19.129375 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9143c43f-b989-4ee3-91bf-38f1cb25c546 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:19.130147 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9143c43f-b989-4ee3-91bf-38f1cb25c546 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:19.238119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] validate_networks() for [('f06a80ac-04e5-4ae1-9b24-c817b700ac9e', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:06:19.336802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9143c43f-b989-4ee3-91bf-38f1cb25c546 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:19.358976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9143c43f-b989-4ee3-91bf-38f1cb25c546 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1218 microversion: 2.1 time: 0.252362 Sep 14 12:06:19.362071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 18/28] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:19 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1218 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:19.388441 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4458a387-8df6-4df5-ac38-b86963aeb4a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:19.389069 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4458a387-8df6-4df5-ac38-b86963aeb4a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:19.478811 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4458a387-8df6-4df5-ac38-b86963aeb4a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:19.495191 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4458a387-8df6-4df5-ac38-b86963aeb4a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:19.496906 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4458a387-8df6-4df5-ac38-b86963aeb4a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:19.498007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4458a387-8df6-4df5-ac38-b86963aeb4a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1281 microversion: 2.20 time: 0.122571 Sep 14 12:06:19.498577 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 19/29] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:19 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:19.514044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8c0b1cb8-99db-4ca3-bbda-c0b9240efc50 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:19.514044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8c0b1cb8-99db-4ca3-bbda-c0b9240efc50 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:19.519105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c0b1cb8-99db-4ca3-bbda-c0b9240efc50 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:19.519785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c0b1cb8-99db-4ca3-bbda-c0b9240efc50 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:19.520091 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c0b1cb8-99db-4ca3-bbda-c0b9240efc50 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:19.520801 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c0b1cb8-99db-4ca3-bbda-c0b9240efc50 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:19.521261 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c0b1cb8-99db-4ca3-bbda-c0b9240efc50 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:19.525100 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c0b1cb8-99db-4ca3-bbda-c0b9240efc50 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:19.648285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8c0b1cb8-99db-4ca3-bbda-c0b9240efc50 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:19.659507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8c0b1cb8-99db-4ca3-bbda-c0b9240efc50 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1225 microversion: 2.1 time: 0.159859 Sep 14 12:06:19.671504 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 20/30] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:19 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1225 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:19.903142 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:06:19.903142 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:06:19.903564 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:06:19.903971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:06:19.904384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:06:19.915742 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:19.916508 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:19.916947 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:19.917676 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:19.918177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:19.918596 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:19.938776 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Getting quotas for project e35c2ab9a9644cadadd4da9a544b944b. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:06:19.940881 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Getting quotas for user 2ba1860ce5504c27816a504776463d9c and project e35c2ab9a9644cadadd4da9a544b944b. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:06:19.953124 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:06:19.957491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:06:20.139496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b584df6a-5289-402d-9ae2-266a00024244 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.035880 Sep 14 12:06:20.141419 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 11/31] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:06:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:06:20.155237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-951de12c-b67a-4b61-bda4-9847e28f9126 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:20.155966 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-951de12c-b67a-4b61-bda4-9847e28f9126 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:20.223859 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-951de12c-b67a-4b61-bda4-9847e28f9126 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:20.232164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-951de12c-b67a-4b61-bda4-9847e28f9126 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1237 microversion: 2.1 time: 0.082163 Sep 14 12:06:20.232753 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 21/32] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:20 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:20.388896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f6ba5ec1-fc7a-4a9f-9109-3fb42529d8e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:20.389504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f6ba5ec1-fc7a-4a9f-9109-3fb42529d8e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:20.395945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ba5ec1-fc7a-4a9f-9109-3fb42529d8e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:20.396441 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ba5ec1-fc7a-4a9f-9109-3fb42529d8e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:20.396886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ba5ec1-fc7a-4a9f-9109-3fb42529d8e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:20.397583 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ba5ec1-fc7a-4a9f-9109-3fb42529d8e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:20.398079 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ba5ec1-fc7a-4a9f-9109-3fb42529d8e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:20.398513 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6ba5ec1-fc7a-4a9f-9109-3fb42529d8e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:20.530045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:20.532095 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:20.535620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f6ba5ec1-fc7a-4a9f-9109-3fb42529d8e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:20.540510 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:20.548145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:20.548145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:20.548145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:20.548145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:20.548689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:20.550819 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f6ba5ec1-fc7a-4a9f-9109-3fb42529d8e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1210 microversion: 2.1 time: 0.166002 Sep 14 12:06:20.564420 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 12/33] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:20 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1210 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:20.647532 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:20.656336 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:20.657810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:20.661757 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b58bd801-1cbe-4bb6-b0c9-76cbd5a390b8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1285 microversion: 2.20 time: 0.136947 Sep 14 12:06:20.661757 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 22/34] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:20 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:20.684885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0a10e8ec-c836-4ead-a3fd-f04a28d3332a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:20.685602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0a10e8ec-c836-4ead-a3fd-f04a28d3332a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:20.694892 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a10e8ec-c836-4ead-a3fd-f04a28d3332a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:20.697330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a10e8ec-c836-4ead-a3fd-f04a28d3332a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:20.697330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a10e8ec-c836-4ead-a3fd-f04a28d3332a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:20.697330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a10e8ec-c836-4ead-a3fd-f04a28d3332a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:20.697330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a10e8ec-c836-4ead-a3fd-f04a28d3332a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:20.697954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0a10e8ec-c836-4ead-a3fd-f04a28d3332a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:20.764754 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0a10e8ec-c836-4ead-a3fd-f04a28d3332a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:20.773107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0a10e8ec-c836-4ead-a3fd-f04a28d3332a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1225 microversion: 2.1 time: 0.092173 Sep 14 12:06:20.773684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 13/35] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:20 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:21.258710 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ebc096c5-4f44-4034-8f84-3003de485088 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:21.259331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ebc096c5-4f44-4034-8f84-3003de485088 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:21.317796 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ebc096c5-4f44-4034-8f84-3003de485088 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:21.324731 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ebc096c5-4f44-4034-8f84-3003de485088 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1237 microversion: 2.1 time: 0.069992 Sep 14 12:06:21.325312 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 23/36] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:21 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:21.583510 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6973468e-e4fd-43ff-94e7-bce36ff43169 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:21.584265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6973468e-e4fd-43ff-94e7-bce36ff43169 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:21.590608 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6973468e-e4fd-43ff-94e7-bce36ff43169 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:21.591252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6973468e-e4fd-43ff-94e7-bce36ff43169 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:21.591796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6973468e-e4fd-43ff-94e7-bce36ff43169 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:21.592635 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6973468e-e4fd-43ff-94e7-bce36ff43169 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:21.593166 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6973468e-e4fd-43ff-94e7-bce36ff43169 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:21.593687 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6973468e-e4fd-43ff-94e7-bce36ff43169 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:21.668415 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6973468e-e4fd-43ff-94e7-bce36ff43169 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:21.679506 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6973468e-e4fd-43ff-94e7-bce36ff43169 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1210 microversion: 2.1 time: 0.099627 Sep 14 12:06:21.683161 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 14/37] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:21 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:21.684608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:21.685235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:21.692305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:21.692815 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:21.693263 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:21.694467 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:21.694467 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:21.694910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:21.756891 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:21.765258 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:21.766763 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:21.768499 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-baeea92e-8007-4eb7-bbb6-b76a5e1bd4c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1285 microversion: 2.20 time: 0.087558 Sep 14 12:06:21.769215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 24/38] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:21 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:21.797031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-551b0f43-c83e-4a18-909e-7d0c972b44db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:21.797675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-551b0f43-c83e-4a18-909e-7d0c972b44db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:21.803975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-551b0f43-c83e-4a18-909e-7d0c972b44db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:21.804463 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-551b0f43-c83e-4a18-909e-7d0c972b44db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:21.804894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-551b0f43-c83e-4a18-909e-7d0c972b44db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:21.805757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-551b0f43-c83e-4a18-909e-7d0c972b44db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:21.806232 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-551b0f43-c83e-4a18-909e-7d0c972b44db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:21.806666 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-551b0f43-c83e-4a18-909e-7d0c972b44db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:21.868845 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-551b0f43-c83e-4a18-909e-7d0c972b44db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:21.876525 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-551b0f43-c83e-4a18-909e-7d0c972b44db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1225 microversion: 2.1 time: 0.083347 Sep 14 12:06:21.877672 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 15/39] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:21 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:22.347919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b230756e-3db0-49d1-af47-df6191c80e17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:22.348534 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b230756e-3db0-49d1-af47-df6191c80e17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:22.359936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b230756e-3db0-49d1-af47-df6191c80e17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:22.360608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b230756e-3db0-49d1-af47-df6191c80e17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:22.362170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b230756e-3db0-49d1-af47-df6191c80e17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:22.367283 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b230756e-3db0-49d1-af47-df6191c80e17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:22.367283 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b230756e-3db0-49d1-af47-df6191c80e17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:22.367283 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b230756e-3db0-49d1-af47-df6191c80e17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:22.444064 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b230756e-3db0-49d1-af47-df6191c80e17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:22.452361 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b230756e-3db0-49d1-af47-df6191c80e17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1241 microversion: 2.1 time: 0.108990 Sep 14 12:06:22.452960 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 25/40] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:22 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:22.711684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2e0ec3c9-1afe-4be4-8d2c-ba42821d54cf tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:22.713429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2e0ec3c9-1afe-4be4-8d2c-ba42821d54cf tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:22.731380 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e0ec3c9-1afe-4be4-8d2c-ba42821d54cf tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:22.733969 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e0ec3c9-1afe-4be4-8d2c-ba42821d54cf tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:22.733969 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e0ec3c9-1afe-4be4-8d2c-ba42821d54cf tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:22.733969 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e0ec3c9-1afe-4be4-8d2c-ba42821d54cf tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:22.733969 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e0ec3c9-1afe-4be4-8d2c-ba42821d54cf tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:22.736998 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e0ec3c9-1afe-4be4-8d2c-ba42821d54cf tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:22.795245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:22.796002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:22.811400 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:22.814374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:22.816119 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:22.852998 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2e0ec3c9-1afe-4be4-8d2c-ba42821d54cf tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:22.853108 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:22.853108 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:22.853108 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:22.857737 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2e0ec3c9-1afe-4be4-8d2c-ba42821d54cf tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1210 microversion: 2.1 time: 0.156102 Sep 14 12:06:22.859111 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 16/41] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:22 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1210 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:22.902134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-eec9d615-897d-440a-b556-b39e03bc9709 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:22.902830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-eec9d615-897d-440a-b556-b39e03bc9709 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:22.918563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eec9d615-897d-440a-b556-b39e03bc9709 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:22.919388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eec9d615-897d-440a-b556-b39e03bc9709 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:22.921060 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eec9d615-897d-440a-b556-b39e03bc9709 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:22.923135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eec9d615-897d-440a-b556-b39e03bc9709 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:22.923891 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eec9d615-897d-440a-b556-b39e03bc9709 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:22.925711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eec9d615-897d-440a-b556-b39e03bc9709 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:22.988938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:23.001772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:23.004716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:23.006921 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-99fb78d3-120f-4fa0-9085-b30f82dcc0e6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.215354 Sep 14 12:06:23.020422 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 26/42] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:22 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:23.041182 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-eec9d615-897d-440a-b556-b39e03bc9709 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:23.051509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-eec9d615-897d-440a-b556-b39e03bc9709 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1217 microversion: 2.1 time: 0.153426 Sep 14 12:06:23.053654 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 17/43] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:22 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:23.476711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-789635ef-e0a1-4d7f-9389-3c5fe7359021 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:23.477356 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-789635ef-e0a1-4d7f-9389-3c5fe7359021 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:23.483699 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-789635ef-e0a1-4d7f-9389-3c5fe7359021 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:23.484190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-789635ef-e0a1-4d7f-9389-3c5fe7359021 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:23.484628 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-789635ef-e0a1-4d7f-9389-3c5fe7359021 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:23.485351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-789635ef-e0a1-4d7f-9389-3c5fe7359021 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:23.485800 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-789635ef-e0a1-4d7f-9389-3c5fe7359021 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:23.486277 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-789635ef-e0a1-4d7f-9389-3c5fe7359021 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:23.571882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-789635ef-e0a1-4d7f-9389-3c5fe7359021 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:23.589528 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-789635ef-e0a1-4d7f-9389-3c5fe7359021 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.117561 Sep 14 12:06:23.590554 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 27/44] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:23 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:23.889038 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2fbc25f3-695a-45a0-b5a4-14a006f64103 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:23.891097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2fbc25f3-695a-45a0-b5a4-14a006f64103 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:23.898927 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fbc25f3-695a-45a0-b5a4-14a006f64103 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:23.900242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fbc25f3-695a-45a0-b5a4-14a006f64103 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:23.901276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fbc25f3-695a-45a0-b5a4-14a006f64103 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:23.902416 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fbc25f3-695a-45a0-b5a4-14a006f64103 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:23.903180 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fbc25f3-695a-45a0-b5a4-14a006f64103 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:23.903794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fbc25f3-695a-45a0-b5a4-14a006f64103 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:24.007288 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2fbc25f3-695a-45a0-b5a4-14a006f64103 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:24.016847 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2fbc25f3-695a-45a0-b5a4-14a006f64103 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1266 microversion: 2.1 time: 0.135069 Sep 14 12:06:24.019791 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 18/45] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:23 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:24.040404 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:24.041447 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:24.048204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:24.052877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:24.052877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:24.052877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:24.052877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:24.053171 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:24.087485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-432e8933-be12-493f-9c41-8ebeb85a9147 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:24.088131 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-432e8933-be12-493f-9c41-8ebeb85a9147 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:24.095300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432e8933-be12-493f-9c41-8ebeb85a9147 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:24.096386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432e8933-be12-493f-9c41-8ebeb85a9147 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:24.096839 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432e8933-be12-493f-9c41-8ebeb85a9147 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:24.098631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432e8933-be12-493f-9c41-8ebeb85a9147 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:24.098631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432e8933-be12-493f-9c41-8ebeb85a9147 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:24.098631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432e8933-be12-493f-9c41-8ebeb85a9147 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:24.262261 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:24.269665 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-432e8933-be12-493f-9c41-8ebeb85a9147 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:24.275338 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:24.277571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:24.277693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-432e8933-be12-493f-9c41-8ebeb85a9147 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1217 microversion: 2.1 time: 0.194510 Sep 14 12:06:24.278819 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 19/46] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:24 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1217 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:24.287301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b5fc768d-1af8-4ebb-b239-bb7b893f17bb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.250531 Sep 14 12:06:24.288079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 28/47] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:24 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:24.619965 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-28a7b228-979b-48c8-9a58-583b94436b17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:24.622752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-28a7b228-979b-48c8-9a58-583b94436b17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:24.627988 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:24.632269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28a7b228-979b-48c8-9a58-583b94436b17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:24.632779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28a7b228-979b-48c8-9a58-583b94436b17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:24.633231 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28a7b228-979b-48c8-9a58-583b94436b17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:24.633986 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28a7b228-979b-48c8-9a58-583b94436b17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:24.636649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28a7b228-979b-48c8-9a58-583b94436b17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:24.637403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28a7b228-979b-48c8-9a58-583b94436b17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:24.742658 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-28a7b228-979b-48c8-9a58-583b94436b17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:24.758399 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-28a7b228-979b-48c8-9a58-583b94436b17 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.142560 Sep 14 12:06:24.759250 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 20/48] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:24 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:25.047363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-efbeec6d-5f6f-4341-9729-9594a8fe781a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:25.049957 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-efbeec6d-5f6f-4341-9729-9594a8fe781a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:25.074936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbeec6d-5f6f-4341-9729-9594a8fe781a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:25.076487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbeec6d-5f6f-4341-9729-9594a8fe781a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:25.076758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbeec6d-5f6f-4341-9729-9594a8fe781a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:25.077790 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbeec6d-5f6f-4341-9729-9594a8fe781a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:25.078561 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbeec6d-5f6f-4341-9729-9594a8fe781a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:25.079484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbeec6d-5f6f-4341-9729-9594a8fe781a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:25.277013 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-efbeec6d-5f6f-4341-9729-9594a8fe781a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:25.286043 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-efbeec6d-5f6f-4341-9729-9594a8fe781a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1274 microversion: 2.1 time: 0.241793 Sep 14 12:06:25.306412 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 29/49] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:25 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1274 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:25.307308 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cf270e4d-cf1d-4b25-9f20-e4820f108735 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:25.308845 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cf270e4d-cf1d-4b25-9f20-e4820f108735 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:25.321035 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:25.324715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:25.327556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf270e4d-cf1d-4b25-9f20-e4820f108735 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:25.328631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf270e4d-cf1d-4b25-9f20-e4820f108735 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:25.329343 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf270e4d-cf1d-4b25-9f20-e4820f108735 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:25.330320 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf270e4d-cf1d-4b25-9f20-e4820f108735 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:25.330930 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf270e4d-cf1d-4b25-9f20-e4820f108735 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:25.331534 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf270e4d-cf1d-4b25-9f20-e4820f108735 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:25.366302 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:25.366816 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:25.368571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:25.371276 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:25.371825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:25.372257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:25.589849 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:25.601608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:25.603566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:25.605026 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-642fa1d0-e127-4444-8893-d8f159a03a60 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.291301 Sep 14 12:06:25.605816 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 30/50] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:25 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:25.643070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cf270e4d-cf1d-4b25-9f20-e4820f108735 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:25.647958 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cf270e4d-cf1d-4b25-9f20-e4820f108735 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.349580 Sep 14 12:06:25.648545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 21/51] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:25 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:25.785584 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-47e60555-bf03-4de2-85ad-fc1fc99ca242 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:25.799594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-47e60555-bf03-4de2-85ad-fc1fc99ca242 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:25.808024 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47e60555-bf03-4de2-85ad-fc1fc99ca242 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:25.808672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47e60555-bf03-4de2-85ad-fc1fc99ca242 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:25.809449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47e60555-bf03-4de2-85ad-fc1fc99ca242 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:25.820060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47e60555-bf03-4de2-85ad-fc1fc99ca242 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:25.854439 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47e60555-bf03-4de2-85ad-fc1fc99ca242 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:25.854439 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47e60555-bf03-4de2-85ad-fc1fc99ca242 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:25.927147 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-47e60555-bf03-4de2-85ad-fc1fc99ca242 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:25.942087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-47e60555-bf03-4de2-85ad-fc1fc99ca242 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.163199 Sep 14 12:06:25.942956 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 31/52] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:25 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:26.317191 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3f9006d0-9088-484d-80b2-34d1d5c6bef4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:26.317798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3f9006d0-9088-484d-80b2-34d1d5c6bef4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:26.326624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f9006d0-9088-484d-80b2-34d1d5c6bef4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:26.327498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f9006d0-9088-484d-80b2-34d1d5c6bef4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:26.328259 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f9006d0-9088-484d-80b2-34d1d5c6bef4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:26.329068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f9006d0-9088-484d-80b2-34d1d5c6bef4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:26.329531 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f9006d0-9088-484d-80b2-34d1d5c6bef4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:26.330001 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f9006d0-9088-484d-80b2-34d1d5c6bef4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:26.402188 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3f9006d0-9088-484d-80b2-34d1d5c6bef4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:26.413361 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3f9006d0-9088-484d-80b2-34d1d5c6bef4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1272 microversion: 2.1 time: 0.097573 Sep 14 12:06:26.413361 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 22/53] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:26 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:26.634716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:26.635616 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:26.642285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:26.642828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:26.643263 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:26.644350 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:26.644880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:26.644880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:26.686764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ef415381-02bd-4d1b-ae32-cfaf7b03fe32 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:26.686764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ef415381-02bd-4d1b-ae32-cfaf7b03fe32 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:26.701420 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef415381-02bd-4d1b-ae32-cfaf7b03fe32 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:26.702093 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef415381-02bd-4d1b-ae32-cfaf7b03fe32 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:26.702758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef415381-02bd-4d1b-ae32-cfaf7b03fe32 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:26.703634 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef415381-02bd-4d1b-ae32-cfaf7b03fe32 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:26.703943 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef415381-02bd-4d1b-ae32-cfaf7b03fe32 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:26.704724 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef415381-02bd-4d1b-ae32-cfaf7b03fe32 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:26.715776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:26.726328 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:26.728164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:26.729875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e3f46731-b592-4fe5-9e44-c10d3c312507 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.099869 Sep 14 12:06:26.734105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 32/54] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:26 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:26.791641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ef415381-02bd-4d1b-ae32-cfaf7b03fe32 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:26.811196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ef415381-02bd-4d1b-ae32-cfaf7b03fe32 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.137635 Sep 14 12:06:26.811196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 23/55] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:26 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:26.968934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d97e797e-c0da-4ac7-9e96-c582bf694eb2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:26.969602 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d97e797e-c0da-4ac7-9e96-c582bf694eb2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:26.977244 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d97e797e-c0da-4ac7-9e96-c582bf694eb2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:26.977745 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d97e797e-c0da-4ac7-9e96-c582bf694eb2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:26.978212 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d97e797e-c0da-4ac7-9e96-c582bf694eb2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:26.978917 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d97e797e-c0da-4ac7-9e96-c582bf694eb2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:26.979365 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d97e797e-c0da-4ac7-9e96-c582bf694eb2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:26.979781 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d97e797e-c0da-4ac7-9e96-c582bf694eb2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:27.052425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d97e797e-c0da-4ac7-9e96-c582bf694eb2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:27.077997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d97e797e-c0da-4ac7-9e96-c582bf694eb2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.113979 Sep 14 12:06:27.079241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 33/56] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:26 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:27.447470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4a12ffc3-736a-424a-aeea-45c6f11c94a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:27.448088 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4a12ffc3-736a-424a-aeea-45c6f11c94a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:27.455859 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a12ffc3-736a-424a-aeea-45c6f11c94a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:27.456362 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a12ffc3-736a-424a-aeea-45c6f11c94a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:27.456888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a12ffc3-736a-424a-aeea-45c6f11c94a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:27.457757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a12ffc3-736a-424a-aeea-45c6f11c94a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:27.458576 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a12ffc3-736a-424a-aeea-45c6f11c94a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:27.459109 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a12ffc3-736a-424a-aeea-45c6f11c94a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:27.617599 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4a12ffc3-736a-424a-aeea-45c6f11c94a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:27.625189 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4a12ffc3-736a-424a-aeea-45c6f11c94a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.195526 Sep 14 12:06:27.625761 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 24/57] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:27 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:27.758974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:27.759536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:27.761495 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=4 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:27.766581 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:27.767070 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:27.768069 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:27.769055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:27.769524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:27.770008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:27.830915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-91f597ec-736e-4bc9-a711-7d5edd19320c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:27.831717 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-91f597ec-736e-4bc9-a711-7d5edd19320c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:27.835396 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:27.837920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91f597ec-736e-4bc9-a711-7d5edd19320c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:27.838417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91f597ec-736e-4bc9-a711-7d5edd19320c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:27.838857 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91f597ec-736e-4bc9-a711-7d5edd19320c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:27.839538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91f597ec-736e-4bc9-a711-7d5edd19320c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:27.839987 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91f597ec-736e-4bc9-a711-7d5edd19320c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:27.840401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91f597ec-736e-4bc9-a711-7d5edd19320c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:27.844045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:27.845541 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:27.846785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0e13e3e9-1885-4434-8dc4-7ba5d0c5c26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.092008 Sep 14 12:06:27.847351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 34/58] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:27 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:27.903225 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-91f597ec-736e-4bc9-a711-7d5edd19320c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:27.911396 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-91f597ec-736e-4bc9-a711-7d5edd19320c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.084461 Sep 14 12:06:27.911905 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 25/59] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:27 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:28.104759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e369b61d-964f-4cc2-a5c7-91e0c79dea74 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:28.105479 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e369b61d-964f-4cc2-a5c7-91e0c79dea74 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:28.118622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e369b61d-964f-4cc2-a5c7-91e0c79dea74 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:28.119292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e369b61d-964f-4cc2-a5c7-91e0c79dea74 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:28.119864 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e369b61d-964f-4cc2-a5c7-91e0c79dea74 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:28.121026 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e369b61d-964f-4cc2-a5c7-91e0c79dea74 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:28.121571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e369b61d-964f-4cc2-a5c7-91e0c79dea74 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:28.122023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e369b61d-964f-4cc2-a5c7-91e0c79dea74 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:28.192429 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e369b61d-964f-4cc2-a5c7-91e0c79dea74 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:28.200599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e369b61d-964f-4cc2-a5c7-91e0c79dea74 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.099735 Sep 14 12:06:28.201169 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 35/60] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:28 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:28.648782 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7a14ac0d-2393-4e5f-b2df-477049f6a808 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:28.649489 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7a14ac0d-2393-4e5f-b2df-477049f6a808 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:28.656086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a14ac0d-2393-4e5f-b2df-477049f6a808 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:28.656645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a14ac0d-2393-4e5f-b2df-477049f6a808 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:28.657322 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a14ac0d-2393-4e5f-b2df-477049f6a808 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:28.658827 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a14ac0d-2393-4e5f-b2df-477049f6a808 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:28.659470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a14ac0d-2393-4e5f-b2df-477049f6a808 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:28.660076 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7a14ac0d-2393-4e5f-b2df-477049f6a808 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:28.812364 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7a14ac0d-2393-4e5f-b2df-477049f6a808 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:28.820275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7a14ac0d-2393-4e5f-b2df-477049f6a808 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.175455 Sep 14 12:06:28.820940 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 26/61] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:28 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:28.874374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:28.875757 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:28.882356 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:28.883018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:28.883642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:28.884533 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:28.884992 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:28.885421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:28.950639 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4fd64bdd-c1ac-4957-9027-da996ceec488 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:28.955680 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4fd64bdd-c1ac-4957-9027-da996ceec488 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:28.978536 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd64bdd-c1ac-4957-9027-da996ceec488 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:28.981456 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd64bdd-c1ac-4957-9027-da996ceec488 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:28.983212 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd64bdd-c1ac-4957-9027-da996ceec488 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:28.983212 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd64bdd-c1ac-4957-9027-da996ceec488 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:28.984020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd64bdd-c1ac-4957-9027-da996ceec488 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:28.985040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fd64bdd-c1ac-4957-9027-da996ceec488 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:28.999494 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:29.004257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:29.015577 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:29.017055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:29.018784 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-528eb602-41db-4469-aba9-d8b0aa9bb349 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.150406 Sep 14 12:06:29.019594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 36/62] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:28 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:29.025775 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:29.069468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4fd64bdd-c1ac-4957-9027-da996ceec488 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:29.077574 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4fd64bdd-c1ac-4957-9027-da996ceec488 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.147040 Sep 14 12:06:29.078186 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 27/63] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:28 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:29.224203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bbae638a-c354-4cc3-8c44-9feb35834fb8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:29.225218 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-bbae638a-c354-4cc3-8c44-9feb35834fb8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:29.232586 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbae638a-c354-4cc3-8c44-9feb35834fb8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:29.249237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbae638a-c354-4cc3-8c44-9feb35834fb8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:29.249237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbae638a-c354-4cc3-8c44-9feb35834fb8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:29.249237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbae638a-c354-4cc3-8c44-9feb35834fb8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:29.249237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbae638a-c354-4cc3-8c44-9feb35834fb8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:29.249654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbae638a-c354-4cc3-8c44-9feb35834fb8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:29.301803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bbae638a-c354-4cc3-8c44-9feb35834fb8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:29.312550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bbae638a-c354-4cc3-8c44-9feb35834fb8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.093680 Sep 14 12:06:29.313263 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 37/64] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:29 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:29.848102 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b9bdf958-ba94-4dd5-999d-65f210d4302a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:29.848836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b9bdf958-ba94-4dd5-999d-65f210d4302a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:29.857981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9bdf958-ba94-4dd5-999d-65f210d4302a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:29.858574 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9bdf958-ba94-4dd5-999d-65f210d4302a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:29.859186 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9bdf958-ba94-4dd5-999d-65f210d4302a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:29.860150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9bdf958-ba94-4dd5-999d-65f210d4302a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:29.860669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9bdf958-ba94-4dd5-999d-65f210d4302a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:29.861162 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9bdf958-ba94-4dd5-999d-65f210d4302a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:29.926558 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=6 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:29.949634 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=30 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:30.016988 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b9bdf958-ba94-4dd5-999d-65f210d4302a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:30.027972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b9bdf958-ba94-4dd5-999d-65f210d4302a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.183762 Sep 14 12:06:30.028568 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 28/65] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:29 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:30.046801 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:30.047381 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:30.054216 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:30.054944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:30.055379 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:30.056074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:30.056524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:30.056940 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:30.100994 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ebd4a77b-4f21-45d4-8a65-ad6c33b005ed tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:30.101610 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ebd4a77b-4f21-45d4-8a65-ad6c33b005ed tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:30.107959 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebd4a77b-4f21-45d4-8a65-ad6c33b005ed tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:30.108449 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebd4a77b-4f21-45d4-8a65-ad6c33b005ed tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:30.108881 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebd4a77b-4f21-45d4-8a65-ad6c33b005ed tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:30.109568 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebd4a77b-4f21-45d4-8a65-ad6c33b005ed tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:30.110051 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebd4a77b-4f21-45d4-8a65-ad6c33b005ed tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:30.110468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebd4a77b-4f21-45d4-8a65-ad6c33b005ed tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:30.121633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:30.130747 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:30.132203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:30.133376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-32fd269d-cea5-45e1-a558-b0af7e502b56 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.090708 Sep 14 12:06:30.134331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 38/66] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:30 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:30.188645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ebd4a77b-4f21-45d4-8a65-ad6c33b005ed tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:30.197106 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ebd4a77b-4f21-45d4-8a65-ad6c33b005ed tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.100340 Sep 14 12:06:30.197697 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 29/67] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:30 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:30.338134 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-18ed5409-ef07-4a22-a866-b774c147730c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:30.338735 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-18ed5409-ef07-4a22-a866-b774c147730c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:30.345039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18ed5409-ef07-4a22-a866-b774c147730c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:30.345529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18ed5409-ef07-4a22-a866-b774c147730c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:30.345991 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18ed5409-ef07-4a22-a866-b774c147730c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:30.346719 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18ed5409-ef07-4a22-a866-b774c147730c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:30.347134 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18ed5409-ef07-4a22-a866-b774c147730c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:30.347548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18ed5409-ef07-4a22-a866-b774c147730c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:30.419389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-18ed5409-ef07-4a22-a866-b774c147730c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:30.428481 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-18ed5409-ef07-4a22-a866-b774c147730c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.094520 Sep 14 12:06:30.429078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 39/68] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:30 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:31.174097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-70c1ed83-1203-4efd-9a7a-24d712335e71 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:31.174097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-70c1ed83-1203-4efd-9a7a-24d712335e71 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:31.174097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70c1ed83-1203-4efd-9a7a-24d712335e71 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:31.174097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70c1ed83-1203-4efd-9a7a-24d712335e71 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:31.175624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70c1ed83-1203-4efd-9a7a-24d712335e71 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:31.175624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70c1ed83-1203-4efd-9a7a-24d712335e71 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:31.175624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70c1ed83-1203-4efd-9a7a-24d712335e71 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:31.175624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70c1ed83-1203-4efd-9a7a-24d712335e71 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:31.176308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:31.176308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:31.176308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:31.176308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:31.176926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:31.176926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:31.176926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:31.176926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:31.206444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-70c1ed83-1203-4efd-9a7a-24d712335e71 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:31.216867 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-70c1ed83-1203-4efd-9a7a-24d712335e71 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.169381 Sep 14 12:06:31.217516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 30/69] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:31 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:31.223171 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6714ed40-7fac-45da-bd1f-c96a1cbdc0d7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:31.223780 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6714ed40-7fac-45da-bd1f-c96a1cbdc0d7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:31.232034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6714ed40-7fac-45da-bd1f-c96a1cbdc0d7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:31.232734 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6714ed40-7fac-45da-bd1f-c96a1cbdc0d7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:31.233174 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6714ed40-7fac-45da-bd1f-c96a1cbdc0d7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:31.233913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6714ed40-7fac-45da-bd1f-c96a1cbdc0d7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:31.234370 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6714ed40-7fac-45da-bd1f-c96a1cbdc0d7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:31.234793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6714ed40-7fac-45da-bd1f-c96a1cbdc0d7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:31.244986 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:31.254514 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:31.256311 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:31.257491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c085d97d-88a1-419e-aa48-2c59a23c0a69 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.100831 Sep 14 12:06:31.258456 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 40/70] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:31 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:31.304219 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6714ed40-7fac-45da-bd1f-c96a1cbdc0d7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:31.312039 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6714ed40-7fac-45da-bd1f-c96a1cbdc0d7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.093514 Sep 14 12:06:31.312609 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 31/71] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:31 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:31.453484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b0e25e13-138c-4467-a1d4-ff134d17b7bc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:31.454177 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b0e25e13-138c-4467-a1d4-ff134d17b7bc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:31.456766 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=24 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:31.458551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:31.462005 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b0e25e13-138c-4467-a1d4-ff134d17b7bc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:31.462484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b0e25e13-138c-4467-a1d4-ff134d17b7bc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:31.462928 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b0e25e13-138c-4467-a1d4-ff134d17b7bc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:31.463624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b0e25e13-138c-4467-a1d4-ff134d17b7bc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:31.464086 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b0e25e13-138c-4467-a1d4-ff134d17b7bc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:31.464519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b0e25e13-138c-4467-a1d4-ff134d17b7bc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:31.531690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b0e25e13-138c-4467-a1d4-ff134d17b7bc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:31.540952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b0e25e13-138c-4467-a1d4-ff134d17b7bc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.091712 Sep 14 12:06:31.541771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 41/72] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:31 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:32.240870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-13e62261-3fab-486d-b584-100d637811a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:32.241516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-13e62261-3fab-486d-b584-100d637811a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:32.247901 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13e62261-3fab-486d-b584-100d637811a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:32.248395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13e62261-3fab-486d-b584-100d637811a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:32.248835 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13e62261-3fab-486d-b584-100d637811a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:32.249533 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13e62261-3fab-486d-b584-100d637811a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:32.250029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13e62261-3fab-486d-b584-100d637811a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:32.250456 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13e62261-3fab-486d-b584-100d637811a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:32.285077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:32.285795 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:32.293045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:32.293534 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:32.294036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:32.294771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:32.295226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:32.295833 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:32.374938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:32.383641 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:32.385119 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:32.386325 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3ff3ac21-b5c8-46f7-b621-7138b2bb0b28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.105826 Sep 14 12:06:32.386946 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 42/73] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:32 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:32.391714 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a932d3b8-1cf2-4691-ac4d-911be15cb663 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:32.392840 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a932d3b8-1cf2-4691-ac4d-911be15cb663 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:32.399358 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a932d3b8-1cf2-4691-ac4d-911be15cb663 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:32.399817 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a932d3b8-1cf2-4691-ac4d-911be15cb663 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:32.400660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a932d3b8-1cf2-4691-ac4d-911be15cb663 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:32.401383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a932d3b8-1cf2-4691-ac4d-911be15cb663 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:32.402063 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a932d3b8-1cf2-4691-ac4d-911be15cb663 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:32.402308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a932d3b8-1cf2-4691-ac4d-911be15cb663 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:32.423314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13e62261-3fab-486d-b584-100d637811a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:32.448097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-13e62261-3fab-486d-b584-100d637811a4 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.211669 Sep 14 12:06:32.448696 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 32/74] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:32 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:32.493256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a932d3b8-1cf2-4691-ac4d-911be15cb663 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:32.502819 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a932d3b8-1cf2-4691-ac4d-911be15cb663 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.114630 Sep 14 12:06:32.587661 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 43/75] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:32 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:32.588022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fff64709-62db-4df9-8624-2b4be6df327e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:32.588022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fff64709-62db-4df9-8624-2b4be6df327e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:32.588022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fff64709-62db-4df9-8624-2b4be6df327e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:32.588022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fff64709-62db-4df9-8624-2b4be6df327e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:32.588373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fff64709-62db-4df9-8624-2b4be6df327e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:32.588373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fff64709-62db-4df9-8624-2b4be6df327e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:32.588373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fff64709-62db-4df9-8624-2b4be6df327e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:32.588373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fff64709-62db-4df9-8624-2b4be6df327e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:32.648423 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fff64709-62db-4df9-8624-2b4be6df327e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:32.657519 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fff64709-62db-4df9-8624-2b4be6df327e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.096566 Sep 14 12:06:32.659335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 33/76] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:32 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:33.417556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:33.435185 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:33.435185 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:33.435185 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:33.435185 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:33.435575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:33.435575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:33.435575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:33.471611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8b793e57-b838-49be-a091-1e5ad315d1e1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:33.472282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8b793e57-b838-49be-a091-1e5ad315d1e1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:33.478394 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b793e57-b838-49be-a091-1e5ad315d1e1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:33.478891 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b793e57-b838-49be-a091-1e5ad315d1e1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:33.479322 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b793e57-b838-49be-a091-1e5ad315d1e1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:33.480016 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b793e57-b838-49be-a091-1e5ad315d1e1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:33.480517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b793e57-b838-49be-a091-1e5ad315d1e1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:33.480943 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b793e57-b838-49be-a091-1e5ad315d1e1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:33.493202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:33.508256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:33.510257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:33.511615 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d2ea8ee7-af6e-44e0-bdeb-e61bcff1c8d1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.101922 Sep 14 12:06:33.512695 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 44/77] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:33 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:33.578828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ff8eca87-989b-4839-bf7c-2b72736b295d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:33.579906 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ff8eca87-989b-4839-bf7c-2b72736b295d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:33.587515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ff8eca87-989b-4839-bf7c-2b72736b295d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:33.588847 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ff8eca87-989b-4839-bf7c-2b72736b295d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:33.589734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ff8eca87-989b-4839-bf7c-2b72736b295d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:33.590739 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ff8eca87-989b-4839-bf7c-2b72736b295d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:33.592348 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ff8eca87-989b-4839-bf7c-2b72736b295d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:33.592982 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ff8eca87-989b-4839-bf7c-2b72736b295d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:33.652152 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8b793e57-b838-49be-a091-1e5ad315d1e1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:33.660619 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8b793e57-b838-49be-a091-1e5ad315d1e1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.192862 Sep 14 12:06:33.661374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 34/78] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:33 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:33.671619 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ff8eca87-989b-4839-bf7c-2b72736b295d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:33.680022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ff8eca87-989b-4839-bf7c-2b72736b295d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.105565 Sep 14 12:06:33.680591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 45/79] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:33 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:33.682176 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5596f676-ab11-4de1-b93f-347f48c0088a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:33.682809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5596f676-ab11-4de1-b93f-347f48c0088a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:33.688934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5596f676-ab11-4de1-b93f-347f48c0088a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:33.689868 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5596f676-ab11-4de1-b93f-347f48c0088a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:33.690306 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5596f676-ab11-4de1-b93f-347f48c0088a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:33.691012 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5596f676-ab11-4de1-b93f-347f48c0088a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:33.691437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5596f676-ab11-4de1-b93f-347f48c0088a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:33.691850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5596f676-ab11-4de1-b93f-347f48c0088a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:33.756807 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5596f676-ab11-4de1-b93f-347f48c0088a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:33.765036 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5596f676-ab11-4de1-b93f-347f48c0088a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.086941 Sep 14 12:06:33.765630 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 35/80] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:33 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:34.539562 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:34.540210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:34.546725 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:34.547211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:34.547639 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:34.548334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:34.548811 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:34.549228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:34.624497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:34.633697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:34.635347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:34.636599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e77efc58-4b81-46cf-9791-2176415d2d20 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.101083 Sep 14 12:06:34.637558 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 46/81] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:34 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:34.684603 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-26836236-1e9a-4402-9376-996075867aff tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:34.685902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-26836236-1e9a-4402-9376-996075867aff tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:34.701773 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26836236-1e9a-4402-9376-996075867aff tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:34.701773 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26836236-1e9a-4402-9376-996075867aff tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:34.702273 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26836236-1e9a-4402-9376-996075867aff tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:34.702585 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26836236-1e9a-4402-9376-996075867aff tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:34.703210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cbbf662b-2a3d-47ae-b840-7d303ba86fd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:34.703352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26836236-1e9a-4402-9376-996075867aff tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:34.703653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26836236-1e9a-4402-9376-996075867aff tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:34.703831 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cbbf662b-2a3d-47ae-b840-7d303ba86fd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:34.721375 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbbf662b-2a3d-47ae-b840-7d303ba86fd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:34.722372 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbbf662b-2a3d-47ae-b840-7d303ba86fd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:34.722992 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbbf662b-2a3d-47ae-b840-7d303ba86fd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:34.723893 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbbf662b-2a3d-47ae-b840-7d303ba86fd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:34.724347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbbf662b-2a3d-47ae-b840-7d303ba86fd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:34.724769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbbf662b-2a3d-47ae-b840-7d303ba86fd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:34.858980 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cbbf662b-2a3d-47ae-b840-7d303ba86fd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:34.868374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cbbf662b-2a3d-47ae-b840-7d303ba86fd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.169131 Sep 14 12:06:34.869182 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 47/82] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:34 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:34.874102 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6b3caadf-05fa-47d4-b1d2-12171b4851dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:34.874327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6b3caadf-05fa-47d4-b1d2-12171b4851dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:34.880767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b3caadf-05fa-47d4-b1d2-12171b4851dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:34.881638 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b3caadf-05fa-47d4-b1d2-12171b4851dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:34.889237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b3caadf-05fa-47d4-b1d2-12171b4851dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:34.889237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b3caadf-05fa-47d4-b1d2-12171b4851dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:34.889237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b3caadf-05fa-47d4-b1d2-12171b4851dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:34.889237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b3caadf-05fa-47d4-b1d2-12171b4851dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:34.949354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-26836236-1e9a-4402-9376-996075867aff tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:34.957816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-26836236-1e9a-4402-9376-996075867aff tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.277032 Sep 14 12:06:34.959788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 36/83] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:34 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:34.967928 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6b3caadf-05fa-47d4-b1d2-12171b4851dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:34.975804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6b3caadf-05fa-47d4-b1d2-12171b4851dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.105837 Sep 14 12:06:34.976390 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 48/84] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:34 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:35.662893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:35.663495 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:35.671314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:35.671314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:35.671314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:35.671663 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:35.671925 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:35.672429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:35.737327 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:35.756758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:35.756758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:35.756758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a6e7f2e6-2dab-4d05-a929-7358ce6bca09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.088833 Sep 14 12:06:35.757059 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 37/85] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:35 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:35.901790 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7f626dec-e36a-4843-af17-008b1bb10954 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:35.902511 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7f626dec-e36a-4843-af17-008b1bb10954 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:35.909310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f626dec-e36a-4843-af17-008b1bb10954 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:35.909791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f626dec-e36a-4843-af17-008b1bb10954 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:35.910245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f626dec-e36a-4843-af17-008b1bb10954 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:35.910927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f626dec-e36a-4843-af17-008b1bb10954 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:35.911382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f626dec-e36a-4843-af17-008b1bb10954 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:35.911815 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f626dec-e36a-4843-af17-008b1bb10954 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:35.981001 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-174d4e98-d982-43c2-aeb6-6b5938cee363 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:35.981192 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7f626dec-e36a-4843-af17-008b1bb10954 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:35.981790 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-174d4e98-d982-43c2-aeb6-6b5938cee363 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:35.989144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-174d4e98-d982-43c2-aeb6-6b5938cee363 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:35.989557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7f626dec-e36a-4843-af17-008b1bb10954 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.091841 Sep 14 12:06:35.989744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-174d4e98-d982-43c2-aeb6-6b5938cee363 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:35.990278 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-174d4e98-d982-43c2-aeb6-6b5938cee363 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:35.991182 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-174d4e98-d982-43c2-aeb6-6b5938cee363 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:35.991286 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 49/86] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:35 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:35.991652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-174d4e98-d982-43c2-aeb6-6b5938cee363 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:35.992084 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-174d4e98-d982-43c2-aeb6-6b5938cee363 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:35.999424 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8c91c83b-cb12-49b2-804c-9b81b52ee2e5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:36.000027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8c91c83b-cb12-49b2-804c-9b81b52ee2e5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:36.009122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c91c83b-cb12-49b2-804c-9b81b52ee2e5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:36.009709 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c91c83b-cb12-49b2-804c-9b81b52ee2e5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:36.010389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c91c83b-cb12-49b2-804c-9b81b52ee2e5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:36.011348 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c91c83b-cb12-49b2-804c-9b81b52ee2e5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:36.011989 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c91c83b-cb12-49b2-804c-9b81b52ee2e5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:36.012783 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c91c83b-cb12-49b2-804c-9b81b52ee2e5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:36.131831 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8c91c83b-cb12-49b2-804c-9b81b52ee2e5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:36.142275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8c91c83b-cb12-49b2-804c-9b81b52ee2e5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.146417 Sep 14 12:06:36.148986 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 50/87] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:35 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:36.178912 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-174d4e98-d982-43c2-aeb6-6b5938cee363 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:36.187049 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-174d4e98-d982-43c2-aeb6-6b5938cee363 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.210091 Sep 14 12:06:36.189301 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 38/88] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:35 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:36.780073 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:36.780703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:36.787728 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:36.788238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:36.788691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:36.789884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:36.790373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:36.791112 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:36.860875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:36.870681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:36.875344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:36.875344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-eef78fa7-9534-4f30-8bc0-046a5511dcd5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.098559 Sep 14 12:06:36.882010 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 51/89] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:36 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:37.018641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-10866593-2bac-4add-b140-ea28be1781a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:37.019273 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-10866593-2bac-4add-b140-ea28be1781a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:37.025361 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-10866593-2bac-4add-b140-ea28be1781a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:37.025841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-10866593-2bac-4add-b140-ea28be1781a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:37.026299 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-10866593-2bac-4add-b140-ea28be1781a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:37.026984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-10866593-2bac-4add-b140-ea28be1781a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:37.027463 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-10866593-2bac-4add-b140-ea28be1781a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:37.027887 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-10866593-2bac-4add-b140-ea28be1781a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:37.094609 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-10866593-2bac-4add-b140-ea28be1781a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:37.102272 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-10866593-2bac-4add-b140-ea28be1781a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.087673 Sep 14 12:06:37.102921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 39/90] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:37 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:37.168390 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e88d9c13-5d66-44c3-8824-d5aec8b4d3d5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:37.169295 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e88d9c13-5d66-44c3-8824-d5aec8b4d3d5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:37.176712 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e88d9c13-5d66-44c3-8824-d5aec8b4d3d5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:37.185001 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e88d9c13-5d66-44c3-8824-d5aec8b4d3d5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:37.185546 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e88d9c13-5d66-44c3-8824-d5aec8b4d3d5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:37.186712 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e88d9c13-5d66-44c3-8824-d5aec8b4d3d5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:37.187131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e88d9c13-5d66-44c3-8824-d5aec8b4d3d5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:37.187644 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e88d9c13-5d66-44c3-8824-d5aec8b4d3d5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:37.211000 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0cf9d705-e660-4a1c-b2e9-6ad27375662c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:37.211700 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0cf9d705-e660-4a1c-b2e9-6ad27375662c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:37.218177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0cf9d705-e660-4a1c-b2e9-6ad27375662c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:37.218412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0cf9d705-e660-4a1c-b2e9-6ad27375662c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:37.218850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0cf9d705-e660-4a1c-b2e9-6ad27375662c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:37.219556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0cf9d705-e660-4a1c-b2e9-6ad27375662c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:37.220013 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0cf9d705-e660-4a1c-b2e9-6ad27375662c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:37.220966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0cf9d705-e660-4a1c-b2e9-6ad27375662c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:37.424733 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e88d9c13-5d66-44c3-8824-d5aec8b4d3d5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:37.434597 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e88d9c13-5d66-44c3-8824-d5aec8b4d3d5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.270888 Sep 14 12:06:37.435536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 52/91] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:37 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:37.539896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0cf9d705-e660-4a1c-b2e9-6ad27375662c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:37.549499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0cf9d705-e660-4a1c-b2e9-6ad27375662c tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.341836 Sep 14 12:06:37.550121 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 40/92] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:37 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:37.904071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:37.904682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:37.911405 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:37.911881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:37.912315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:37.913009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:37.913453 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:37.913884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:37.932489 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:37.975938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:37.984699 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:37.986830 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:37.987957 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1b957896-d830-46b6-8909-98aa938dd0b1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.088118 Sep 14 12:06:37.989789 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 53/93] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:37 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:38.127180 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e12e18ae-7387-4127-959d-f36a20e30a03 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:38.128531 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e12e18ae-7387-4127-959d-f36a20e30a03 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:38.135086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e12e18ae-7387-4127-959d-f36a20e30a03 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:38.135774 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e12e18ae-7387-4127-959d-f36a20e30a03 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:38.136382 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e12e18ae-7387-4127-959d-f36a20e30a03 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:38.137239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e12e18ae-7387-4127-959d-f36a20e30a03 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:38.137834 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e12e18ae-7387-4127-959d-f36a20e30a03 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:38.138428 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e12e18ae-7387-4127-959d-f36a20e30a03 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:38.204568 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e12e18ae-7387-4127-959d-f36a20e30a03 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:38.213546 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e12e18ae-7387-4127-959d-f36a20e30a03 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.092123 Sep 14 12:06:38.214178 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 41/94] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:38 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:38.457423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0ae16a24-c2fc-44ae-8bb4-2af366e5c9ee tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:38.458052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0ae16a24-c2fc-44ae-8bb4-2af366e5c9ee tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:38.464397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ae16a24-c2fc-44ae-8bb4-2af366e5c9ee tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:38.464891 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ae16a24-c2fc-44ae-8bb4-2af366e5c9ee tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:38.465328 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ae16a24-c2fc-44ae-8bb4-2af366e5c9ee tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:38.466077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ae16a24-c2fc-44ae-8bb4-2af366e5c9ee tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:38.466537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ae16a24-c2fc-44ae-8bb4-2af366e5c9ee tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:38.466965 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ae16a24-c2fc-44ae-8bb4-2af366e5c9ee tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:38.537905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0ae16a24-c2fc-44ae-8bb4-2af366e5c9ee tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:38.544513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0ae16a24-c2fc-44ae-8bb4-2af366e5c9ee tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.090891 Sep 14 12:06:38.545412 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 54/95] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:38 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:38.578224 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c30cbf00-a8b4-41ce-9a40-872986930ab0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:38.578935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c30cbf00-a8b4-41ce-9a40-872986930ab0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:38.585228 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c30cbf00-a8b4-41ce-9a40-872986930ab0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:38.585809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c30cbf00-a8b4-41ce-9a40-872986930ab0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:38.586348 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c30cbf00-a8b4-41ce-9a40-872986930ab0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:38.587112 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c30cbf00-a8b4-41ce-9a40-872986930ab0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:38.587628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c30cbf00-a8b4-41ce-9a40-872986930ab0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:38.588150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c30cbf00-a8b4-41ce-9a40-872986930ab0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:38.722270 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c30cbf00-a8b4-41ce-9a40-872986930ab0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:38.731148 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c30cbf00-a8b4-41ce-9a40-872986930ab0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.156570 Sep 14 12:06:38.746085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 42/96] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:38 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:39.019568 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:39.020176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:39.026910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:39.027399 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:39.027825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:39.028645 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:39.029091 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:39.029503 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:39.091695 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:39.100322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:39.101750 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:39.102888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-85b9242b-3bf7-429a-a63b-cb837fe6cf25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.088004 Sep 14 12:06:39.103449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 55/97] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:39 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:39.238491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ac2c1982-f4f9-4dd4-abd6-177b4cb6481d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:39.239304 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ac2c1982-f4f9-4dd4-abd6-177b4cb6481d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:39.246031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c1982-f4f9-4dd4-abd6-177b4cb6481d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:39.246527 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c1982-f4f9-4dd4-abd6-177b4cb6481d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:39.246970 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c1982-f4f9-4dd4-abd6-177b4cb6481d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:39.248139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c1982-f4f9-4dd4-abd6-177b4cb6481d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:39.248929 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c1982-f4f9-4dd4-abd6-177b4cb6481d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:39.248929 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c1982-f4f9-4dd4-abd6-177b4cb6481d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:39.327085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ac2c1982-f4f9-4dd4-abd6-177b4cb6481d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:39.347975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ac2c1982-f4f9-4dd4-abd6-177b4cb6481d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.106716 Sep 14 12:06:39.347975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 43/98] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:39 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:39.570990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cec04c67-233e-4d4f-897e-1c622e4b838f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:39.571737 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cec04c67-233e-4d4f-897e-1c622e4b838f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:39.578033 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cec04c67-233e-4d4f-897e-1c622e4b838f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:39.578558 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cec04c67-233e-4d4f-897e-1c622e4b838f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:39.578987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cec04c67-233e-4d4f-897e-1c622e4b838f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:39.579841 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cec04c67-233e-4d4f-897e-1c622e4b838f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:39.580587 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cec04c67-233e-4d4f-897e-1c622e4b838f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:39.581329 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cec04c67-233e-4d4f-897e-1c622e4b838f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:39.647291 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cec04c67-233e-4d4f-897e-1c622e4b838f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:39.656455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cec04c67-233e-4d4f-897e-1c622e4b838f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.089351 Sep 14 12:06:39.657036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 56/99] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:39 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:39.761587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-36ae8760-da93-4705-a859-f0ec9408585d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:39.762252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-36ae8760-da93-4705-a859-f0ec9408585d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:39.771556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36ae8760-da93-4705-a859-f0ec9408585d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:39.771556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36ae8760-da93-4705-a859-f0ec9408585d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:39.771556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36ae8760-da93-4705-a859-f0ec9408585d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:39.771556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36ae8760-da93-4705-a859-f0ec9408585d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:39.771833 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36ae8760-da93-4705-a859-f0ec9408585d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:39.771833 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36ae8760-da93-4705-a859-f0ec9408585d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:39.776020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:39.920704 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-36ae8760-da93-4705-a859-f0ec9408585d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:39.922166 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-36ae8760-da93-4705-a859-f0ec9408585d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.164988 Sep 14 12:06:39.922929 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 44/100] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:39 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:40.128244 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:40.128850 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:40.136154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:40.136644 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:40.137111 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:40.137800 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:40.138392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:40.138813 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:40.201773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:40.211247 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:40.212684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:40.213770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d4fca63c-fb9b-4f6f-b5ca-40698348389e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1277 microversion: 2.20 time: 0.089584 Sep 14 12:06:40.214365 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 57/101] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:40 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:40.362708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cc7b5124-d671-4016-b927-026e8c71bc25 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:40.363323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cc7b5124-d671-4016-b927-026e8c71bc25 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:40.369449 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc7b5124-d671-4016-b927-026e8c71bc25 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:40.369977 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc7b5124-d671-4016-b927-026e8c71bc25 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:40.370420 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc7b5124-d671-4016-b927-026e8c71bc25 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:40.371124 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc7b5124-d671-4016-b927-026e8c71bc25 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:40.371583 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc7b5124-d671-4016-b927-026e8c71bc25 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:40.372241 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc7b5124-d671-4016-b927-026e8c71bc25 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:40.442580 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cc7b5124-d671-4016-b927-026e8c71bc25 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:40.450516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cc7b5124-d671-4016-b927-026e8c71bc25 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1273 microversion: 2.1 time: 0.091741 Sep 14 12:06:40.451099 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 45/102] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:40 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:40.680746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d4c34b65-ad6f-4e58-a9a0-5aa1dea504fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:40.682228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d4c34b65-ad6f-4e58-a9a0-5aa1dea504fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:40.690550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4c34b65-ad6f-4e58-a9a0-5aa1dea504fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:40.691507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4c34b65-ad6f-4e58-a9a0-5aa1dea504fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:40.692215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4c34b65-ad6f-4e58-a9a0-5aa1dea504fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:40.693096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4c34b65-ad6f-4e58-a9a0-5aa1dea504fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:40.693552 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4c34b65-ad6f-4e58-a9a0-5aa1dea504fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:40.694007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4c34b65-ad6f-4e58-a9a0-5aa1dea504fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:40.797466 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d4c34b65-ad6f-4e58-a9a0-5aa1dea504fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:40.819104 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d4c34b65-ad6f-4e58-a9a0-5aa1dea504fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.142585 Sep 14 12:06:40.820512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 58/103] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:40 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:40.945001 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-572b5530-127a-4a60-9d64-dd798bb4e16e tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:40.946456 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-572b5530-127a-4a60-9d64-dd798bb4e16e tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:40.953404 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-572b5530-127a-4a60-9d64-dd798bb4e16e tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:40.954014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-572b5530-127a-4a60-9d64-dd798bb4e16e tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:40.954464 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-572b5530-127a-4a60-9d64-dd798bb4e16e tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:40.955264 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-572b5530-127a-4a60-9d64-dd798bb4e16e tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:40.955719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-572b5530-127a-4a60-9d64-dd798bb4e16e tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:40.956140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-572b5530-127a-4a60-9d64-dd798bb4e16e tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:41.248322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:41.248941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:41.253795 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-572b5530-127a-4a60-9d64-dd798bb4e16e tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:41.268598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-572b5530-127a-4a60-9d64-dd798bb4e16e tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.325514 Sep 14 12:06:41.270314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 46/104] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:40 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:41.285499 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:41.290762 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:41.291906 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:41.294622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:41.296459 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:41.299324 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:41.404460 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:41.414386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:41.416955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:41.417692 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b7e80efa-f395-4538-b079-46c9bda30ff4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1333 microversion: 2.20 time: 0.182790 Sep 14 12:06:41.418464 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 59/105] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:41 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1333 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:41.479094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-99da6d6f-42f5-4a84-b631-f9e39aa617c7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:41.479844 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-99da6d6f-42f5-4a84-b631-f9e39aa617c7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:41.486210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99da6d6f-42f5-4a84-b631-f9e39aa617c7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:41.488653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99da6d6f-42f5-4a84-b631-f9e39aa617c7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:41.488653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99da6d6f-42f5-4a84-b631-f9e39aa617c7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:41.488653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99da6d6f-42f5-4a84-b631-f9e39aa617c7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:41.488653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99da6d6f-42f5-4a84-b631-f9e39aa617c7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:41.489431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99da6d6f-42f5-4a84-b631-f9e39aa617c7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:41.666427 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-99da6d6f-42f5-4a84-b631-f9e39aa617c7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:41.680083 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-99da6d6f-42f5-4a84-b631-f9e39aa617c7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1279 microversion: 2.1 time: 0.204562 Sep 14 12:06:41.689936 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 47/106] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:41 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1279 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:41.844778 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ec2b2e2c-4a58-487d-9d55-f2db62303ee3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:41.846252 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ec2b2e2c-4a58-487d-9d55-f2db62303ee3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:41.857852 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec2b2e2c-4a58-487d-9d55-f2db62303ee3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:41.858614 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec2b2e2c-4a58-487d-9d55-f2db62303ee3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:41.859274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec2b2e2c-4a58-487d-9d55-f2db62303ee3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:41.860216 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec2b2e2c-4a58-487d-9d55-f2db62303ee3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:41.862311 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec2b2e2c-4a58-487d-9d55-f2db62303ee3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:41.867650 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec2b2e2c-4a58-487d-9d55-f2db62303ee3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:41.978039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ec2b2e2c-4a58-487d-9d55-f2db62303ee3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:41.990157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ec2b2e2c-4a58-487d-9d55-f2db62303ee3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1233 microversion: 2.1 time: 0.150479 Sep 14 12:06:41.991379 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 60/107] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:41 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1233 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:42.297013 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3f2145b0-92ee-4b2c-b59e-5d44706b3bd0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:42.297555 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3f2145b0-92ee-4b2c-b59e-5d44706b3bd0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:42.305263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f2145b0-92ee-4b2c-b59e-5d44706b3bd0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:42.310136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f2145b0-92ee-4b2c-b59e-5d44706b3bd0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:42.310136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f2145b0-92ee-4b2c-b59e-5d44706b3bd0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:42.310136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f2145b0-92ee-4b2c-b59e-5d44706b3bd0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:42.310136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f2145b0-92ee-4b2c-b59e-5d44706b3bd0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:42.310885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3f2145b0-92ee-4b2c-b59e-5d44706b3bd0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:42.443135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:42.443744 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:42.452234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:42.454282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:42.456283 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:42.457027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:42.457489 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:42.461472 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:42.563212 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3f2145b0-92ee-4b2c-b59e-5d44706b3bd0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:42.571302 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3f2145b0-92ee-4b2c-b59e-5d44706b3bd0 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.277922 Sep 14 12:06:42.587071 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 48/108] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:42 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:42.605290 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:42.617113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:42.618995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:42.620144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cb96d7c6-a55e-44f2-9bd8-6af029066a98 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1341 microversion: 2.20 time: 0.180918 Sep 14 12:06:42.621191 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 61/109] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:42 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1341 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:42.706117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7acc0022-a31d-4770-a8d9-cb8876bd6f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:42.707444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7acc0022-a31d-4770-a8d9-cb8876bd6f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:42.715483 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7acc0022-a31d-4770-a8d9-cb8876bd6f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:42.717468 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7acc0022-a31d-4770-a8d9-cb8876bd6f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:42.717941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7acc0022-a31d-4770-a8d9-cb8876bd6f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:42.718669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-aa83f723-6e58-4fa1-904b-5024689db8f1 req-c72a23c3-97c5-4b6f-8f22-704dc90bc4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5195b11-b310-408b-a3d8-75d39abd9bba", "tag": "8886c0e9-3f34-4a35-b75b-b420c97f524e"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:42.718809 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7acc0022-a31d-4770-a8d9-cb8876bd6f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:42.719264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7acc0022-a31d-4770-a8d9-cb8876bd6f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:42.719694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7acc0022-a31d-4770-a8d9-cb8876bd6f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:42.734584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-aa83f723-6e58-4fa1-904b-5024689db8f1 req-c72a23c3-97c5-4b6f-8f22-704dc90bc4cf service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:42.735346 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-aa83f723-6e58-4fa1-904b-5024689db8f1 req-c72a23c3-97c5-4b6f-8f22-704dc90bc4cf service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:42.735989 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-aa83f723-6e58-4fa1-904b-5024689db8f1 req-c72a23c3-97c5-4b6f-8f22-704dc90bc4cf service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:42.760090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-aa83f723-6e58-4fa1-904b-5024689db8f1 req-c72a23c3-97c5-4b6f-8f22-704dc90bc4cf service nova] Creating event network-changed:8886c0e9-3f34-4a35-b75b-b420c97f524e for instance a5195b11-b310-408b-a3d8-75d39abd9bba on hv-cinder-84496 Sep 14 12:06:42.760938 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-aa83f723-6e58-4fa1-904b-5024689db8f1 req-c72a23c3-97c5-4b6f-8f22-704dc90bc4cf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121153) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 12:06:42.761406 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-aa83f723-6e58-4fa1-904b-5024689db8f1 req-c72a23c3-97c5-4b6f-8f22-704dc90bc4cf service nova] Acquired lock "compute-rpcapi-router" {{(pid=121153) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 12:06:42.762674 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9aee937-bf55-447f-8539-b822301b4a41 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:42.763243 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9aee937-bf55-447f-8539-b822301b4a41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:42.763909 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9aee937-bf55-447f-8539-b822301b4a41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:42.764861 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9aee937-bf55-447f-8539-b822301b4a41 None None] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:42.765498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9aee937-bf55-447f-8539-b822301b4a41 None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:42.766421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9aee937-bf55-447f-8539-b822301b4a41 None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:42.777329 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.compute.rpcapi [None req-b9aee937-bf55-447f-8539-b822301b4a41 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 14 12:06:42.778758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9aee937-bf55-447f-8539-b822301b4a41 None None] Releasing lock "compute-rpcapi-router" {{(pid=121153) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 12:06:42.798004 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b9aee937-bf55-447f-8539-b822301b4a41 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203569 Sep 14 12:06:42.799552 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 49/110] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:06:42.844118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7acc0022-a31d-4770-a8d9-cb8876bd6f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:42.852693 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7acc0022-a31d-4770-a8d9-cb8876bd6f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1279 microversion: 2.1 time: 0.151659 Sep 14 12:06:42.856103 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 62/111] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:42 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:43.031543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-ecfd59c5-94a9-47bd-8da6-b0e08984d93a req-a147ccb3-7727-4454-9ff1-1d0a62dbf608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7649ff4f-2137-402c-a210-b4b9f4c95b82", "tag": "1284ee63-88b4-458d-ab2c-4d6fca36d2a1"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:43.035418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d9f07be2-e649-43d3-a03f-18d43abbe1c3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:43.036438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d9f07be2-e649-43d3-a03f-18d43abbe1c3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:43.046690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9f07be2-e649-43d3-a03f-18d43abbe1c3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:43.047589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9f07be2-e649-43d3-a03f-18d43abbe1c3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:43.048188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9f07be2-e649-43d3-a03f-18d43abbe1c3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:43.049699 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9f07be2-e649-43d3-a03f-18d43abbe1c3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:43.054770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9f07be2-e649-43d3-a03f-18d43abbe1c3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:43.056941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9f07be2-e649-43d3-a03f-18d43abbe1c3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:43.060256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ecfd59c5-94a9-47bd-8da6-b0e08984d93a req-a147ccb3-7727-4454-9ff1-1d0a62dbf608 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:43.061056 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ecfd59c5-94a9-47bd-8da6-b0e08984d93a req-a147ccb3-7727-4454-9ff1-1d0a62dbf608 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:43.063107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ecfd59c5-94a9-47bd-8da6-b0e08984d93a req-a147ccb3-7727-4454-9ff1-1d0a62dbf608 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:43.103832 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-ecfd59c5-94a9-47bd-8da6-b0e08984d93a req-a147ccb3-7727-4454-9ff1-1d0a62dbf608 service nova] Creating event network-changed:1284ee63-88b4-458d-ab2c-4d6fca36d2a1 for instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 on hv-cinder-84496 Sep 14 12:06:43.117037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-ecfd59c5-94a9-47bd-8da6-b0e08984d93a req-a147ccb3-7727-4454-9ff1-1d0a62dbf608 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185820 Sep 14 12:06:43.120130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 50/112] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:06:43.389403 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d9f07be2-e649-43d3-a03f-18d43abbe1c3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:43.400722 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d9f07be2-e649-43d3-a03f-18d43abbe1c3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1289 microversion: 2.1 time: 0.371019 Sep 14 12:06:43.401352 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 63/113] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:43 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1289 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:43.600587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-949bf226-4028-4ea2-9fd3-7d3f3388955a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:43.601322 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-949bf226-4028-4ea2-9fd3-7d3f3388955a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:43.607483 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-949bf226-4028-4ea2-9fd3-7d3f3388955a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:43.607963 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-949bf226-4028-4ea2-9fd3-7d3f3388955a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:43.608508 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-949bf226-4028-4ea2-9fd3-7d3f3388955a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:43.609198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-949bf226-4028-4ea2-9fd3-7d3f3388955a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:43.609640 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-949bf226-4028-4ea2-9fd3-7d3f3388955a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:43.610092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-949bf226-4028-4ea2-9fd3-7d3f3388955a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:43.648830 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:43.649818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:43.656698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:43.657204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:43.657648 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:43.658423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:43.658905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:43.659516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:43.776455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:43.787162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:43.789989 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:43.790500 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-fcd049b0-a292-48b2-9e5a-bd02f0116937 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1339 microversion: 2.20 time: 0.145500 Sep 14 12:06:43.791449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 64/114] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:43 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:43.884267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b8b89703-83b7-4c73-b456-29a943e6ccc5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:43.884958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b8b89703-83b7-4c73-b456-29a943e6ccc5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:43.895559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8b89703-83b7-4c73-b456-29a943e6ccc5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:43.897477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8b89703-83b7-4c73-b456-29a943e6ccc5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:43.898140 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8b89703-83b7-4c73-b456-29a943e6ccc5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:43.899214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8b89703-83b7-4c73-b456-29a943e6ccc5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:43.899825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8b89703-83b7-4c73-b456-29a943e6ccc5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:43.900972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8b89703-83b7-4c73-b456-29a943e6ccc5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:43.925306 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-949bf226-4028-4ea2-9fd3-7d3f3388955a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:43.976599 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-949bf226-4028-4ea2-9fd3-7d3f3388955a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.380372 Sep 14 12:06:43.987346 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 51/115] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:43 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:44.217117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b8b89703-83b7-4c73-b456-29a943e6ccc5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:44.231212 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b8b89703-83b7-4c73-b456-29a943e6ccc5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.351729 Sep 14 12:06:44.233235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 65/116] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:43 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:44.428603 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fd79198e-3ded-4672-8075-73f4408d6ae5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:44.429381 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fd79198e-3ded-4672-8075-73f4408d6ae5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:44.435636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd79198e-3ded-4672-8075-73f4408d6ae5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:44.436210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd79198e-3ded-4672-8075-73f4408d6ae5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:44.436724 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd79198e-3ded-4672-8075-73f4408d6ae5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:44.437492 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd79198e-3ded-4672-8075-73f4408d6ae5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:44.438075 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd79198e-3ded-4672-8075-73f4408d6ae5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:44.438576 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd79198e-3ded-4672-8075-73f4408d6ae5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:44.534163 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fd79198e-3ded-4672-8075-73f4408d6ae5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:44.551228 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fd79198e-3ded-4672-8075-73f4408d6ae5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1307 microversion: 2.1 time: 0.126278 Sep 14 12:06:44.553100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 52/117] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:44 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:44.817932 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:44.818849 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:44.827867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:44.828610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:44.829106 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:44.830550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:44.831091 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:44.832185 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:44.966767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:44.974913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:44.976362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:44.977505 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1d6046ff-71ad-4d71-acc3-9fdcadfea7d0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.164426 Sep 14 12:06:44.978081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 66/118] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:44 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:45.007504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dd66f778-98fd-40ed-82c2-d11e4feeef89 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:45.008207 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dd66f778-98fd-40ed-82c2-d11e4feeef89 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:45.015773 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd66f778-98fd-40ed-82c2-d11e4feeef89 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:45.016259 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd66f778-98fd-40ed-82c2-d11e4feeef89 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:45.016694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd66f778-98fd-40ed-82c2-d11e4feeef89 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:45.018101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd66f778-98fd-40ed-82c2-d11e4feeef89 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:45.018555 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd66f778-98fd-40ed-82c2-d11e4feeef89 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:45.018978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd66f778-98fd-40ed-82c2-d11e4feeef89 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:45.165486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dd66f778-98fd-40ed-82c2-d11e4feeef89 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:45.186108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dd66f778-98fd-40ed-82c2-d11e4feeef89 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.170990 Sep 14 12:06:45.186108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 53/119] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:45 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:45.191893 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-cc8254e2-961e-4663-8905-2bce5c377846 req-a3b69862-606b-4959-883d-e43095f37ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f808ebd-698e-480a-9eac-4ef62bcc2b7b", "tag": "de5f0781-b564-4893-84ac-ebcb69c0ddc9"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:45.204641 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-cc8254e2-961e-4663-8905-2bce5c377846 req-a3b69862-606b-4959-883d-e43095f37ab3 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:45.205735 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-cc8254e2-961e-4663-8905-2bce5c377846 req-a3b69862-606b-4959-883d-e43095f37ab3 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:45.213209 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-cc8254e2-961e-4663-8905-2bce5c377846 req-a3b69862-606b-4959-883d-e43095f37ab3 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:45.230118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-cc8254e2-961e-4663-8905-2bce5c377846 req-a3b69862-606b-4959-883d-e43095f37ab3 service nova] Creating event network-changed:de5f0781-b564-4893-84ac-ebcb69c0ddc9 for instance 3f808ebd-698e-480a-9eac-4ef62bcc2b7b on hv-cinder-84496 Sep 14 12:06:45.230118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-cc8254e2-961e-4663-8905-2bce5c377846 req-a3b69862-606b-4959-883d-e43095f37ab3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121152) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 12:06:45.230118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-cc8254e2-961e-4663-8905-2bce5c377846 req-a3b69862-606b-4959-883d-e43095f37ab3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121152) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 12:06:45.230706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd7d6e3a-3eb4-468d-9a14-0cbfbb65e088 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:45.230706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd7d6e3a-3eb4-468d-9a14-0cbfbb65e088 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:45.231074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd7d6e3a-3eb4-468d-9a14-0cbfbb65e088 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:45.231777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd7d6e3a-3eb4-468d-9a14-0cbfbb65e088 None None] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:45.232216 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd7d6e3a-3eb4-468d-9a14-0cbfbb65e088 None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:45.232623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd7d6e3a-3eb4-468d-9a14-0cbfbb65e088 None None] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:45.243299 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.compute.rpcapi [None req-dd7d6e3a-3eb4-468d-9a14-0cbfbb65e088 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 14 12:06:45.243615 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd7d6e3a-3eb4-468d-9a14-0cbfbb65e088 None None] Releasing lock "compute-rpcapi-router" {{(pid=121152) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 12:06:45.255850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4276a303-f1fc-4fb1-b6d0-04efb66b3c0d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:45.256458 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4276a303-f1fc-4fb1-b6d0-04efb66b3c0d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:45.262832 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4276a303-f1fc-4fb1-b6d0-04efb66b3c0d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:45.263305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-dd7d6e3a-3eb4-468d-9a14-0cbfbb65e088 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075755 Sep 14 12:06:45.263430 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4276a303-f1fc-4fb1-b6d0-04efb66b3c0d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:45.263920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4276a303-f1fc-4fb1-b6d0-04efb66b3c0d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:45.264050 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 67/120] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:06:45.264971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4276a303-f1fc-4fb1-b6d0-04efb66b3c0d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:45.271799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4276a303-f1fc-4fb1-b6d0-04efb66b3c0d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:45.271799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4276a303-f1fc-4fb1-b6d0-04efb66b3c0d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:45.417294 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4276a303-f1fc-4fb1-b6d0-04efb66b3c0d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:45.426559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4276a303-f1fc-4fb1-b6d0-04efb66b3c0d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.175189 Sep 14 12:06:45.427155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 54/121] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:45 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:45.577044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b8f35ee8-137a-470c-b7dd-d1539ac2b7b4 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:45.577751 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b8f35ee8-137a-470c-b7dd-d1539ac2b7b4 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:45.584392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8f35ee8-137a-470c-b7dd-d1539ac2b7b4 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:45.584877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8f35ee8-137a-470c-b7dd-d1539ac2b7b4 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:45.585319 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8f35ee8-137a-470c-b7dd-d1539ac2b7b4 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:45.586053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8f35ee8-137a-470c-b7dd-d1539ac2b7b4 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:45.586496 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8f35ee8-137a-470c-b7dd-d1539ac2b7b4 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:45.586924 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8f35ee8-137a-470c-b7dd-d1539ac2b7b4 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:45.653690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b8f35ee8-137a-470c-b7dd-d1539ac2b7b4 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:45.664003 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b8f35ee8-137a-470c-b7dd-d1539ac2b7b4 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1307 microversion: 2.1 time: 0.091393 Sep 14 12:06:45.664594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 68/122] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:45 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:46.002184 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:46.002807 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:46.009361 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:46.009960 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:46.010300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:46.011048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:46.011503 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:46.011942 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:46.198839 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-86a730bc-a0a4-4159-a22e-241d1948d905 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:46.199268 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-86a730bc-a0a4-4159-a22e-241d1948d905 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:46.206047 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-86a730bc-a0a4-4159-a22e-241d1948d905 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:46.206578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-86a730bc-a0a4-4159-a22e-241d1948d905 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:46.207010 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-86a730bc-a0a4-4159-a22e-241d1948d905 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:46.207875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-86a730bc-a0a4-4159-a22e-241d1948d905 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:46.208326 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-86a730bc-a0a4-4159-a22e-241d1948d905 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:46.208750 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-86a730bc-a0a4-4159-a22e-241d1948d905 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:46.369738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:46.378203 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:46.379617 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:46.380722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d8fffeea-b238-443a-8c1c-479c9e07ee5a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.382575 Sep 14 12:06:46.381290 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 55/123] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:45 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:46.397782 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-86a730bc-a0a4-4159-a22e-241d1948d905 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:46.406470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-86a730bc-a0a4-4159-a22e-241d1948d905 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.213804 Sep 14 12:06:46.407234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 69/124] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:46 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:46.449679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6647312a-5bd0-4300-b994-31f865c39aac tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:46.450325 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6647312a-5bd0-4300-b994-31f865c39aac tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:46.456379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6647312a-5bd0-4300-b994-31f865c39aac tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:46.456881 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6647312a-5bd0-4300-b994-31f865c39aac tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:46.457312 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6647312a-5bd0-4300-b994-31f865c39aac tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:46.458023 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6647312a-5bd0-4300-b994-31f865c39aac tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:46.458470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6647312a-5bd0-4300-b994-31f865c39aac tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:46.458925 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6647312a-5bd0-4300-b994-31f865c39aac tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:46.590919 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6647312a-5bd0-4300-b994-31f865c39aac tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:46.600049 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6647312a-5bd0-4300-b994-31f865c39aac tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.154244 Sep 14 12:06:46.600625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 56/125] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:46 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:46.686770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5c19e3e9-2ba8-4158-b886-ceffdf1d2aa9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:46.687416 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5c19e3e9-2ba8-4158-b886-ceffdf1d2aa9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:46.694831 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c19e3e9-2ba8-4158-b886-ceffdf1d2aa9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:46.695363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c19e3e9-2ba8-4158-b886-ceffdf1d2aa9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:46.695800 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c19e3e9-2ba8-4158-b886-ceffdf1d2aa9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:46.696498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c19e3e9-2ba8-4158-b886-ceffdf1d2aa9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:46.697016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c19e3e9-2ba8-4158-b886-ceffdf1d2aa9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:46.697536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c19e3e9-2ba8-4158-b886-ceffdf1d2aa9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:46.717222 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:46.760639 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5c19e3e9-2ba8-4158-b886-ceffdf1d2aa9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:46.768871 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5c19e3e9-2ba8-4158-b886-ceffdf1d2aa9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1307 microversion: 2.1 time: 0.085993 Sep 14 12:06:46.769439 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 70/126] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:46 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1307 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:47.406421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:47.407059 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:47.413066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:47.413554 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:47.414028 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:47.414717 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:47.415169 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:47.415615 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:47.433363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5a2589b1-d21b-407a-90a0-9afdd30a1770 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:47.434068 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5a2589b1-d21b-407a-90a0-9afdd30a1770 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:47.440601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a2589b1-d21b-407a-90a0-9afdd30a1770 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:47.441247 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a2589b1-d21b-407a-90a0-9afdd30a1770 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:47.441678 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a2589b1-d21b-407a-90a0-9afdd30a1770 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:47.442396 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a2589b1-d21b-407a-90a0-9afdd30a1770 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:47.442843 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a2589b1-d21b-407a-90a0-9afdd30a1770 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:47.443256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a2589b1-d21b-407a-90a0-9afdd30a1770 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:47.625972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:47.633591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5a2589b1-d21b-407a-90a0-9afdd30a1770 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:47.634511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:47.635945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:47.637048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dd03c426-5aa6-41c8-9a28-c87f861370f3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.234794 Sep 14 12:06:47.637609 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 57/127] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:47 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:47.641325 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5a2589b1-d21b-407a-90a0-9afdd30a1770 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.212100 Sep 14 12:06:47.641906 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 71/128] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:47 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:47.644971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e3d5cc8e-a15f-4e47-ae9f-56266d102cec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:47.645752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e3d5cc8e-a15f-4e47-ae9f-56266d102cec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:47.651983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3d5cc8e-a15f-4e47-ae9f-56266d102cec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:47.652584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3d5cc8e-a15f-4e47-ae9f-56266d102cec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:47.653118 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3d5cc8e-a15f-4e47-ae9f-56266d102cec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:47.653935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3d5cc8e-a15f-4e47-ae9f-56266d102cec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:47.654508 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3d5cc8e-a15f-4e47-ae9f-56266d102cec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:47.654934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3d5cc8e-a15f-4e47-ae9f-56266d102cec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:47.787043 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e3d5cc8e-a15f-4e47-ae9f-56266d102cec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:47.792440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a04a56a8-7b5e-45c8-a8ee-2211fb2be3b0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:47.793060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a04a56a8-7b5e-45c8-a8ee-2211fb2be3b0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:47.796237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e3d5cc8e-a15f-4e47-ae9f-56266d102cec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.155080 Sep 14 12:06:47.796947 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 58/129] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:47 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:47.800747 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a04a56a8-7b5e-45c8-a8ee-2211fb2be3b0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:47.801262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a04a56a8-7b5e-45c8-a8ee-2211fb2be3b0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:47.801701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a04a56a8-7b5e-45c8-a8ee-2211fb2be3b0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:47.802434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a04a56a8-7b5e-45c8-a8ee-2211fb2be3b0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:47.802894 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a04a56a8-7b5e-45c8-a8ee-2211fb2be3b0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:47.803351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a04a56a8-7b5e-45c8-a8ee-2211fb2be3b0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:47.875144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a04a56a8-7b5e-45c8-a8ee-2211fb2be3b0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:47.883164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a04a56a8-7b5e-45c8-a8ee-2211fb2be3b0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1307 microversion: 2.1 time: 0.094627 Sep 14 12:06:47.886360 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 72/130] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:47 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:48.662138 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:48.662807 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:48.664418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1993db6a-c13f-48fe-8433-f206fe2189dd tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:48.664819 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1993db6a-c13f-48fe-8433-f206fe2189dd tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:48.668846 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:48.669360 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:48.669935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:48.670638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:48.670773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1993db6a-c13f-48fe-8433-f206fe2189dd tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:48.671086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:48.671261 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1993db6a-c13f-48fe-8433-f206fe2189dd tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:48.671510 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:48.671788 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1993db6a-c13f-48fe-8433-f206fe2189dd tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:48.672383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1993db6a-c13f-48fe-8433-f206fe2189dd tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:48.672837 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1993db6a-c13f-48fe-8433-f206fe2189dd tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:48.673822 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1993db6a-c13f-48fe-8433-f206fe2189dd tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:48.864129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:48.867298 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1993db6a-c13f-48fe-8433-f206fe2189dd tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:48.872875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:48.874439 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:48.875384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1993db6a-c13f-48fe-8433-f206fe2189dd tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.214901 Sep 14 12:06:48.875699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-21ddaeb4-cec5-4337-8dae-87d08419d0d8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.218242 Sep 14 12:06:48.875962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 73/131] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:48 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:48.877944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 59/132] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:48 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:48.880826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f8226522-7369-4972-8d44-d2cd9d1db1b9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:48.881433 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f8226522-7369-4972-8d44-d2cd9d1db1b9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:48.887202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f8226522-7369-4972-8d44-d2cd9d1db1b9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:48.887683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f8226522-7369-4972-8d44-d2cd9d1db1b9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:48.888111 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f8226522-7369-4972-8d44-d2cd9d1db1b9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:48.888788 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f8226522-7369-4972-8d44-d2cd9d1db1b9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:48.889236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f8226522-7369-4972-8d44-d2cd9d1db1b9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:48.889650 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f8226522-7369-4972-8d44-d2cd9d1db1b9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:48.906122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f61f4ee5-0300-48d1-b0e4-64c2695fe163 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:48.906751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f61f4ee5-0300-48d1-b0e4-64c2695fe163 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:48.913252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f61f4ee5-0300-48d1-b0e4-64c2695fe163 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:48.913744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f61f4ee5-0300-48d1-b0e4-64c2695fe163 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:48.914225 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f61f4ee5-0300-48d1-b0e4-64c2695fe163 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:48.914921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f61f4ee5-0300-48d1-b0e4-64c2695fe163 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:48.915418 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f61f4ee5-0300-48d1-b0e4-64c2695fe163 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:48.915943 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f61f4ee5-0300-48d1-b0e4-64c2695fe163 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:48.987348 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f61f4ee5-0300-48d1-b0e4-64c2695fe163 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:48.995425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f61f4ee5-0300-48d1-b0e4-64c2695fe163 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1307 microversion: 2.1 time: 0.092759 Sep 14 12:06:48.995764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 60/133] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:48 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:49.047969 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f8226522-7369-4972-8d44-d2cd9d1db1b9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:49.056312 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f8226522-7369-4972-8d44-d2cd9d1db1b9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.179240 Sep 14 12:06:49.056884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 74/134] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:48 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:49.899305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c57fedbb-59ba-405e-9233-99ca32758d88 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:49.900161 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c57fedbb-59ba-405e-9233-99ca32758d88 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:49.900598 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:49.901203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:49.906607 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c57fedbb-59ba-405e-9233-99ca32758d88 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:49.907014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c57fedbb-59ba-405e-9233-99ca32758d88 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:49.907382 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c57fedbb-59ba-405e-9233-99ca32758d88 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:49.908055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:49.908820 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c57fedbb-59ba-405e-9233-99ca32758d88 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:49.908974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:49.909290 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c57fedbb-59ba-405e-9233-99ca32758d88 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:49.909406 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:49.909711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c57fedbb-59ba-405e-9233-99ca32758d88 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:49.910054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:49.910502 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:49.910941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:50.114146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:50.115153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c57fedbb-59ba-405e-9233-99ca32758d88 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:50.118935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:50.123800 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:50.124171 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c57fedbb-59ba-405e-9233-99ca32758d88 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.228964 Sep 14 12:06:50.124754 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 61/135] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:49 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:50.125224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:50.126971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2604b0de-9676-4057-8610-867556eff4b2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.230011 Sep 14 12:06:50.127654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 75/136] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:49 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:50.129716 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-55bfae32-de28-495a-a5bc-2c12364e28dd tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:50.130364 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-55bfae32-de28-495a-a5bc-2c12364e28dd tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:50.132605 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cd39f952-b0e4-4712-901c-c11d322f98b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:50.133267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cd39f952-b0e4-4712-901c-c11d322f98b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:50.136350 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55bfae32-de28-495a-a5bc-2c12364e28dd tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:50.136753 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55bfae32-de28-495a-a5bc-2c12364e28dd tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:50.137196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55bfae32-de28-495a-a5bc-2c12364e28dd tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:50.137940 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55bfae32-de28-495a-a5bc-2c12364e28dd tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:50.138385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55bfae32-de28-495a-a5bc-2c12364e28dd tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:50.138812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-55bfae32-de28-495a-a5bc-2c12364e28dd tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:50.141090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cd39f952-b0e4-4712-901c-c11d322f98b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:50.142794 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cd39f952-b0e4-4712-901c-c11d322f98b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:50.143589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cd39f952-b0e4-4712-901c-c11d322f98b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:50.145015 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cd39f952-b0e4-4712-901c-c11d322f98b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:50.145790 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cd39f952-b0e4-4712-901c-c11d322f98b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:50.146579 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cd39f952-b0e4-4712-901c-c11d322f98b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:50.242767 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-55bfae32-de28-495a-a5bc-2c12364e28dd tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:50.251979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-55bfae32-de28-495a-a5bc-2c12364e28dd tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1307 microversion: 2.1 time: 0.125582 Sep 14 12:06:50.252600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 62/137] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:50 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1307 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:50.322471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cd39f952-b0e4-4712-901c-c11d322f98b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:50.330508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cd39f952-b0e4-4712-901c-c11d322f98b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.201338 Sep 14 12:06:50.331545 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 76/138] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:50 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:51.148202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6d7961fd-0bbf-406c-b539-9aa433a6459a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:51.148898 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6d7961fd-0bbf-406c-b539-9aa433a6459a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:51.161424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d7961fd-0bbf-406c-b539-9aa433a6459a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:51.161424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d7961fd-0bbf-406c-b539-9aa433a6459a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:51.161424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d7961fd-0bbf-406c-b539-9aa433a6459a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:51.161424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d7961fd-0bbf-406c-b539-9aa433a6459a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:51.161944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d7961fd-0bbf-406c-b539-9aa433a6459a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:51.161944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d7961fd-0bbf-406c-b539-9aa433a6459a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:51.162117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:51.162117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:51.167364 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:51.167881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:51.168335 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:51.169076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:51.169528 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:51.169996 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:51.379237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6d7961fd-0bbf-406c-b539-9aa433a6459a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:51.389448 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6d7961fd-0bbf-406c-b539-9aa433a6459a tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.244860 Sep 14 12:06:51.389623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:51.390390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 63/139] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:51 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:51.396179 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f0e4672a-c8b2-44ed-b476-a73d677c941d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:51.397022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f0e4672a-c8b2-44ed-b476-a73d677c941d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:51.404776 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e4672a-c8b2-44ed-b476-a73d677c941d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:51.405268 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e4672a-c8b2-44ed-b476-a73d677c941d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:51.405897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e4672a-c8b2-44ed-b476-a73d677c941d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:51.407062 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e4672a-c8b2-44ed-b476-a73d677c941d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:51.408168 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e4672a-c8b2-44ed-b476-a73d677c941d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:51.408757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e4672a-c8b2-44ed-b476-a73d677c941d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:51.416143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:51.419471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:51.419968 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-55980b8f-0c68-4007-b861-4f23612f6ed2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.263444 Sep 14 12:06:51.421207 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 77/140] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:51 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:51.427133 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cc37abfa-355f-4a30-917f-c22678ed2352 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:51.427740 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cc37abfa-355f-4a30-917f-c22678ed2352 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:51.437052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc37abfa-355f-4a30-917f-c22678ed2352 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:51.438018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc37abfa-355f-4a30-917f-c22678ed2352 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:51.439215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc37abfa-355f-4a30-917f-c22678ed2352 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:51.440626 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc37abfa-355f-4a30-917f-c22678ed2352 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:51.441108 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc37abfa-355f-4a30-917f-c22678ed2352 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:51.441587 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc37abfa-355f-4a30-917f-c22678ed2352 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:51.543435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0e4672a-c8b2-44ed-b476-a73d677c941d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:51.552276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f0e4672a-c8b2-44ed-b476-a73d677c941d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1307 microversion: 2.1 time: 0.160736 Sep 14 12:06:51.552888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 64/141] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:51 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1307 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:51.634109 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cc37abfa-355f-4a30-917f-c22678ed2352 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:51.645613 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cc37abfa-355f-4a30-917f-c22678ed2352 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.223120 Sep 14 12:06:51.646521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 78/142] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:51 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:52.419323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b1979dc4-0eec-4292-b39b-6b5d11037fc1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:52.420711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b1979dc4-0eec-4292-b39b-6b5d11037fc1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:52.429504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1979dc4-0eec-4292-b39b-6b5d11037fc1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:52.430410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1979dc4-0eec-4292-b39b-6b5d11037fc1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:52.432054 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1979dc4-0eec-4292-b39b-6b5d11037fc1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:52.433303 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1979dc4-0eec-4292-b39b-6b5d11037fc1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:52.434236 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1979dc4-0eec-4292-b39b-6b5d11037fc1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:52.436858 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1979dc4-0eec-4292-b39b-6b5d11037fc1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:52.460400 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:52.462352 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:52.486371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:52.487427 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:52.487950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:52.490851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:52.491571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:52.492078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:52.778465 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:52.869929 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b1979dc4-0eec-4292-b39b-6b5d11037fc1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:52.894313 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b1979dc4-0eec-4292-b39b-6b5d11037fc1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.468377 Sep 14 12:06:52.895004 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 65/143] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:52 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:52.903281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ae9302c1-23f4-45b8-bf1b-b960c69cdd25 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:52.903906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ae9302c1-23f4-45b8-bf1b-b960c69cdd25 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:52.913724 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae9302c1-23f4-45b8-bf1b-b960c69cdd25 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:52.914247 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae9302c1-23f4-45b8-bf1b-b960c69cdd25 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:52.914980 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae9302c1-23f4-45b8-bf1b-b960c69cdd25 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:52.916066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae9302c1-23f4-45b8-bf1b-b960c69cdd25 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:52.916892 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae9302c1-23f4-45b8-bf1b-b960c69cdd25 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:52.917503 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae9302c1-23f4-45b8-bf1b-b960c69cdd25 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:52.919218 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:52.932969 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:52.934418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:52.935733 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-537b9640-04d6-46dd-9d70-76ed11103053 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.483002 Sep 14 12:06:52.958342 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 79/144] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:52 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:52.958342 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a485704c-6b23-4e5e-9689-ed5b015bb101 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:52.958342 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a485704c-6b23-4e5e-9689-ed5b015bb101 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:52.967043 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a485704c-6b23-4e5e-9689-ed5b015bb101 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:52.967560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a485704c-6b23-4e5e-9689-ed5b015bb101 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:52.968134 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a485704c-6b23-4e5e-9689-ed5b015bb101 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:52.968861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a485704c-6b23-4e5e-9689-ed5b015bb101 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:52.969322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a485704c-6b23-4e5e-9689-ed5b015bb101 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:52.969830 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a485704c-6b23-4e5e-9689-ed5b015bb101 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:53.092494 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ae9302c1-23f4-45b8-bf1b-b960c69cdd25 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:53.101280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ae9302c1-23f4-45b8-bf1b-b960c69cdd25 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1295 microversion: 2.1 time: 0.204935 Sep 14 12:06:53.101883 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 66/145] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:52 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1295 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:53.322365 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a485704c-6b23-4e5e-9689-ed5b015bb101 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:53.331105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a485704c-6b23-4e5e-9689-ed5b015bb101 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.388412 Sep 14 12:06:53.331591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 80/146] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:52 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:53.913927 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-77ab9dc7-4679-49c3-8814-e0466a1bd548 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:53.914673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-77ab9dc7-4679-49c3-8814-e0466a1bd548 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:53.921296 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77ab9dc7-4679-49c3-8814-e0466a1bd548 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:53.922272 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77ab9dc7-4679-49c3-8814-e0466a1bd548 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:53.922950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77ab9dc7-4679-49c3-8814-e0466a1bd548 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:53.923863 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77ab9dc7-4679-49c3-8814-e0466a1bd548 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:53.924520 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77ab9dc7-4679-49c3-8814-e0466a1bd548 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:53.925129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77ab9dc7-4679-49c3-8814-e0466a1bd548 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:53.970013 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:53.977896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:53.980327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:53.981163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:53.982189 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:53.984031 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:53.984539 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:53.985314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:54.439520 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77ab9dc7-4679-49c3-8814-e0466a1bd548 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:54.447862 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-77ab9dc7-4679-49c3-8814-e0466a1bd548 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.542753 Sep 14 12:06:54.453727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 67/147] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:53 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:54.456593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:54.466649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-ce8e1317-393f-4fcf-8ff0-20066fb6b62a req-adf032f3-4fe0-4148-974f-f55ef9015d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b1312a-8b45-4481-9a44-f330379d0c8f", "tag": "906fb0c9-14b7-4949-943a-c084b122ae8b"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:06:54.480957 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ce8e1317-393f-4fcf-8ff0-20066fb6b62a req-adf032f3-4fe0-4148-974f-f55ef9015d58 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:54.482507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ce8e1317-393f-4fcf-8ff0-20066fb6b62a req-adf032f3-4fe0-4148-974f-f55ef9015d58 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:54.483281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ce8e1317-393f-4fcf-8ff0-20066fb6b62a req-adf032f3-4fe0-4148-974f-f55ef9015d58 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:54.485370 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:54.487059 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:54.489433 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a408d49c-2c3d-4047-b028-767fc7ca2f26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.523749 Sep 14 12:06:54.489433 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 81/148] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:53 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:54.495568 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d05862eb-b013-4c77-a7b3-db795770543c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:54.496322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d05862eb-b013-4c77-a7b3-db795770543c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:54.500468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-ce8e1317-393f-4fcf-8ff0-20066fb6b62a req-adf032f3-4fe0-4148-974f-f55ef9015d58 service nova] Creating event network-changed:906fb0c9-14b7-4949-943a-c084b122ae8b for instance b7b1312a-8b45-4481-9a44-f330379d0c8f on hv-cinder-84496 Sep 14 12:06:54.503659 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d05862eb-b013-4c77-a7b3-db795770543c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:54.503659 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d05862eb-b013-4c77-a7b3-db795770543c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:54.503659 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d05862eb-b013-4c77-a7b3-db795770543c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:54.505939 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d05862eb-b013-4c77-a7b3-db795770543c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:54.505939 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d05862eb-b013-4c77-a7b3-db795770543c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:54.506231 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d05862eb-b013-4c77-a7b3-db795770543c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:54.509614 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-ce8e1317-393f-4fcf-8ff0-20066fb6b62a req-adf032f3-4fe0-4148-974f-f55ef9015d58 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059232 Sep 14 12:06:54.510231 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 68/149] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:06:54.515122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5f85f41e-74ab-4175-a8d2-6bc61d9559f4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:54.515830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5f85f41e-74ab-4175-a8d2-6bc61d9559f4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:54.523138 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f85f41e-74ab-4175-a8d2-6bc61d9559f4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:54.523683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f85f41e-74ab-4175-a8d2-6bc61d9559f4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:54.524125 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f85f41e-74ab-4175-a8d2-6bc61d9559f4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:54.525104 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f85f41e-74ab-4175-a8d2-6bc61d9559f4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:54.525608 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f85f41e-74ab-4175-a8d2-6bc61d9559f4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:54.526063 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5f85f41e-74ab-4175-a8d2-6bc61d9559f4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:54.787643 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d05862eb-b013-4c77-a7b3-db795770543c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:54.793614 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5f85f41e-74ab-4175-a8d2-6bc61d9559f4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:54.797847 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d05862eb-b013-4c77-a7b3-db795770543c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.307022 Sep 14 12:06:54.799100 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 82/150] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:54 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:54.803106 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5f85f41e-74ab-4175-a8d2-6bc61d9559f4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.292050 Sep 14 12:06:54.803687 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 69/151] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:54 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:55.474121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ea383e89-624c-4583-9bc0-001e3beaa1ac tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:55.475434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ea383e89-624c-4583-9bc0-001e3beaa1ac tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:55.478626 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:55.482861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ea383e89-624c-4583-9bc0-001e3beaa1ac tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:55.483717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ea383e89-624c-4583-9bc0-001e3beaa1ac tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:55.484313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ea383e89-624c-4583-9bc0-001e3beaa1ac tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:55.485722 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ea383e89-624c-4583-9bc0-001e3beaa1ac tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:55.486482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ea383e89-624c-4583-9bc0-001e3beaa1ac tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:55.491397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ea383e89-624c-4583-9bc0-001e3beaa1ac tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:55.515047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:55.515649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:55.518622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=99 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:55.525274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:55.525764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:55.533381 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:55.534668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:55.535522 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:55.536128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:55.689547 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ea383e89-624c-4583-9bc0-001e3beaa1ac tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:55.699299 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ea383e89-624c-4583-9bc0-001e3beaa1ac tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.230615 Sep 14 12:06:55.714506 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 83/152] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:55 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:55.759634 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:55.768636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:55.770139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:55.771306 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-454ea38d-7c76-4bb8-8cb8-1143da0b4a82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.260103 Sep 14 12:06:55.772269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 70/153] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:55 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:55.821821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-18057a38-b251-40b6-a207-b00c3ab0994e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:55.822673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-18057a38-b251-40b6-a207-b00c3ab0994e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:55.829765 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18057a38-b251-40b6-a207-b00c3ab0994e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:55.830280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18057a38-b251-40b6-a207-b00c3ab0994e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:55.830715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18057a38-b251-40b6-a207-b00c3ab0994e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:55.831413 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18057a38-b251-40b6-a207-b00c3ab0994e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:55.831867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18057a38-b251-40b6-a207-b00c3ab0994e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:55.832287 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18057a38-b251-40b6-a207-b00c3ab0994e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:55.836300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2f27ec10-a222-4ade-964f-d84c4892ccd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:55.836943 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2f27ec10-a222-4ade-964f-d84c4892ccd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:55.845787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f27ec10-a222-4ade-964f-d84c4892ccd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:55.846301 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f27ec10-a222-4ade-964f-d84c4892ccd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:55.846745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f27ec10-a222-4ade-964f-d84c4892ccd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:55.847449 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f27ec10-a222-4ade-964f-d84c4892ccd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:55.847901 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f27ec10-a222-4ade-964f-d84c4892ccd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:55.848323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f27ec10-a222-4ade-964f-d84c4892ccd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:56.046541 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-18057a38-b251-40b6-a207-b00c3ab0994e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:56.063083 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-18057a38-b251-40b6-a207-b00c3ab0994e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.245403 Sep 14 12:06:56.077890 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 84/154] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:55 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:56.083700 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2f27ec10-a222-4ade-964f-d84c4892ccd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:56.092428 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2f27ec10-a222-4ade-964f-d84c4892ccd9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.265514 Sep 14 12:06:56.102341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 71/155] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:55 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:56.723977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8b958931-6358-4d92-8fd4-1ee8bad77286 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:56.724839 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8b958931-6358-4d92-8fd4-1ee8bad77286 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:56.732701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8b958931-6358-4d92-8fd4-1ee8bad77286 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:56.733282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8b958931-6358-4d92-8fd4-1ee8bad77286 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:56.733783 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8b958931-6358-4d92-8fd4-1ee8bad77286 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:56.734740 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8b958931-6358-4d92-8fd4-1ee8bad77286 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:56.735299 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8b958931-6358-4d92-8fd4-1ee8bad77286 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:56.739606 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8b958931-6358-4d92-8fd4-1ee8bad77286 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:56.799255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:56.799863 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:56.806261 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:56.806982 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:56.807421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:56.808121 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:56.808838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:56.809184 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:57.003059 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8b958931-6358-4d92-8fd4-1ee8bad77286 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:57.015560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8b958931-6358-4d92-8fd4-1ee8bad77286 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.295662 Sep 14 12:06:57.033911 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 85/156] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:56 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:06:57.034405 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:57.045065 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:57.046843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:57.052834 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5bf92357-d463-4e16-9045-ddae50970732 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.254141 Sep 14 12:06:57.052834 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 72/157] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:56 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:06:57.090101 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a2ff938b-c886-4300-a9a6-d9d9b8b72a68 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:57.090682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a2ff938b-c886-4300-a9a6-d9d9b8b72a68 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:57.099558 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a2ff938b-c886-4300-a9a6-d9d9b8b72a68 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:57.100067 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a2ff938b-c886-4300-a9a6-d9d9b8b72a68 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:57.101131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a2ff938b-c886-4300-a9a6-d9d9b8b72a68 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:57.101369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a2ff938b-c886-4300-a9a6-d9d9b8b72a68 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:57.101630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a2ff938b-c886-4300-a9a6-d9d9b8b72a68 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:57.102660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a2ff938b-c886-4300-a9a6-d9d9b8b72a68 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:57.117331 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9b2801d3-c0cf-4d8e-8e0d-4a870b76470b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:57.118548 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9b2801d3-c0cf-4d8e-8e0d-4a870b76470b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:57.133618 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2801d3-c0cf-4d8e-8e0d-4a870b76470b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:57.134205 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2801d3-c0cf-4d8e-8e0d-4a870b76470b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:57.134795 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2801d3-c0cf-4d8e-8e0d-4a870b76470b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:57.135935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2801d3-c0cf-4d8e-8e0d-4a870b76470b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:57.136732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2801d3-c0cf-4d8e-8e0d-4a870b76470b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:57.137221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2801d3-c0cf-4d8e-8e0d-4a870b76470b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:57.405651 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a2ff938b-c886-4300-a9a6-d9d9b8b72a68 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:57.414057 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9b2801d3-c0cf-4d8e-8e0d-4a870b76470b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:57.414785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a2ff938b-c886-4300-a9a6-d9d9b8b72a68 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.331151 Sep 14 12:06:57.415383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 86/158] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:57 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:57.425595 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9b2801d3-c0cf-4d8e-8e0d-4a870b76470b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.312401 Sep 14 12:06:57.426704 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 73/159] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:57 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:58.046332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8712d980-45da-45ce-bc82-30a323b9ac69 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:58.047105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8712d980-45da-45ce-bc82-30a323b9ac69 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:58.060517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8712d980-45da-45ce-bc82-30a323b9ac69 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:58.060517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8712d980-45da-45ce-bc82-30a323b9ac69 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:58.060517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8712d980-45da-45ce-bc82-30a323b9ac69 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:58.060517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8712d980-45da-45ce-bc82-30a323b9ac69 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:58.060904 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8712d980-45da-45ce-bc82-30a323b9ac69 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:58.060904 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8712d980-45da-45ce-bc82-30a323b9ac69 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:58.066935 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:58.081040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:58.083159 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:58.091967 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:58.092905 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:58.093470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:58.094333 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:58.094954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:58.095672 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:58.329839 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8712d980-45da-45ce-bc82-30a323b9ac69 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:58.338039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8712d980-45da-45ce-bc82-30a323b9ac69 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.296640 Sep 14 12:06:58.340550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 87/160] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:58 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:58.368336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:58.379617 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:58.381090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:58.382459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-448dbd79-755b-4b7b-afe2-a9351d08a9e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.309581 Sep 14 12:06:58.382854 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 74/161] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:58 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:58.438023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b01ef7d6-c624-40f8-a997-cc96237e14bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:58.439530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b01ef7d6-c624-40f8-a997-cc96237e14bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:58.445641 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b01ef7d6-c624-40f8-a997-cc96237e14bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:58.446189 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b01ef7d6-c624-40f8-a997-cc96237e14bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:58.446624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b01ef7d6-c624-40f8-a997-cc96237e14bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:58.447321 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b01ef7d6-c624-40f8-a997-cc96237e14bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:58.447771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b01ef7d6-c624-40f8-a997-cc96237e14bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:58.448186 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b01ef7d6-c624-40f8-a997-cc96237e14bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:58.449691 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2777b477-25f6-4642-a13e-34df9e0068f1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:58.450414 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2777b477-25f6-4642-a13e-34df9e0068f1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:58.457615 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2777b477-25f6-4642-a13e-34df9e0068f1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:58.458199 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2777b477-25f6-4642-a13e-34df9e0068f1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:58.458690 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2777b477-25f6-4642-a13e-34df9e0068f1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:58.459394 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2777b477-25f6-4642-a13e-34df9e0068f1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:58.459961 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2777b477-25f6-4642-a13e-34df9e0068f1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:58.460385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2777b477-25f6-4642-a13e-34df9e0068f1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:58.663571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b01ef7d6-c624-40f8-a997-cc96237e14bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:58.666869 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2777b477-25f6-4642-a13e-34df9e0068f1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:58.675504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2777b477-25f6-4642-a13e-34df9e0068f1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.229631 Sep 14 12:06:58.676445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 75/162] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:58 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:58.677530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b01ef7d6-c624-40f8-a997-cc96237e14bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.243212 Sep 14 12:06:58.678285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 88/163] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:58 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:59.366752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f609683b-dfc2-48ba-af04-187bdc4e0781 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:59.367363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f609683b-dfc2-48ba-af04-187bdc4e0781 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:59.374130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f609683b-dfc2-48ba-af04-187bdc4e0781 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:59.374130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f609683b-dfc2-48ba-af04-187bdc4e0781 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:59.374130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f609683b-dfc2-48ba-af04-187bdc4e0781 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:59.374791 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f609683b-dfc2-48ba-af04-187bdc4e0781 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:59.375245 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f609683b-dfc2-48ba-af04-187bdc4e0781 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:59.375657 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f609683b-dfc2-48ba-af04-187bdc4e0781 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:59.410282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:59.410970 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:59.418164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:59.418661 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:59.419105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:59.420008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:59.420549 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:59.421027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:59.606104 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f609683b-dfc2-48ba-af04-187bdc4e0781 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:59.625669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f609683b-dfc2-48ba-af04-187bdc4e0781 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.261946 Sep 14 12:06:59.645816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 76/164] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:59 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:06:59.653278 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:59.666164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:59.668561 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:59.669714 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4bb528aa-0c5c-44bc-bb2f-ca2e19c7c993 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.263635 Sep 14 12:06:59.670348 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 89/165] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:06:59 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:06:59.700979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a671a617-f349-4328-b995-78e9ce18590e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:59.701589 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a671a617-f349-4328-b995-78e9ce18590e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:59.717749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a671a617-f349-4328-b995-78e9ce18590e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:59.718084 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a671a617-f349-4328-b995-78e9ce18590e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:59.720605 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-871128b8-3011-4b97-854e-1c230d13b75b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:06:59.721222 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-871128b8-3011-4b97-854e-1c230d13b75b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:06:59.725763 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a671a617-f349-4328-b995-78e9ce18590e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:59.725763 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a671a617-f349-4328-b995-78e9ce18590e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:59.725763 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a671a617-f349-4328-b995-78e9ce18590e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:59.725763 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a671a617-f349-4328-b995-78e9ce18590e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:59.738466 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-871128b8-3011-4b97-854e-1c230d13b75b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:59.738958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-871128b8-3011-4b97-854e-1c230d13b75b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:59.739397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-871128b8-3011-4b97-854e-1c230d13b75b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:59.740096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-871128b8-3011-4b97-854e-1c230d13b75b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:06:59.740551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-871128b8-3011-4b97-854e-1c230d13b75b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:06:59.740972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-871128b8-3011-4b97-854e-1c230d13b75b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:06:59.981728 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-871128b8-3011-4b97-854e-1c230d13b75b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:59.983166 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a671a617-f349-4328-b995-78e9ce18590e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:06:59.994122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-871128b8-3011-4b97-854e-1c230d13b75b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.282987 Sep 14 12:06:59.994804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 90/166] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:59 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:00.010009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a671a617-f349-4328-b995-78e9ce18590e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.306395 Sep 14 12:07:00.010009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 77/167] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:06:59 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:00.652748 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c6d89794-74fd-4ef9-9c3a-d0ae0ba05502 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:00.653399 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c6d89794-74fd-4ef9-9c3a-d0ae0ba05502 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:00.660116 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6d89794-74fd-4ef9-9c3a-d0ae0ba05502 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:00.661188 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6d89794-74fd-4ef9-9c3a-d0ae0ba05502 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:00.661910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6d89794-74fd-4ef9-9c3a-d0ae0ba05502 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:00.662772 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6d89794-74fd-4ef9-9c3a-d0ae0ba05502 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:00.663400 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6d89794-74fd-4ef9-9c3a-d0ae0ba05502 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:00.663997 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c6d89794-74fd-4ef9-9c3a-d0ae0ba05502 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:00.709390 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:00.714407 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:00.716204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:00.721289 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:00.722102 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:00.722635 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:00.723455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:00.724003 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:00.724528 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:01.467097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c6d89794-74fd-4ef9-9c3a-d0ae0ba05502 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:01.482049 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c6d89794-74fd-4ef9-9c3a-d0ae0ba05502 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.834113 Sep 14 12:07:01.486062 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 78/168] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:00 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:01.539501 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:01.557152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:01.559922 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:01.561360 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-87beb601-a642-48db-8d6d-f77b425f171c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.857306 Sep 14 12:07:01.562774 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 91/169] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:00 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:07:01.571268 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b8d216d9-b886-4d80-aac3-3906e689e76e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:01.574529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b8d216d9-b886-4d80-aac3-3906e689e76e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:01.584825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8d216d9-b886-4d80-aac3-3906e689e76e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:01.585682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8d216d9-b886-4d80-aac3-3906e689e76e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:01.586418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8d216d9-b886-4d80-aac3-3906e689e76e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:01.587382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8d216d9-b886-4d80-aac3-3906e689e76e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:01.588224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8d216d9-b886-4d80-aac3-3906e689e76e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:01.589457 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b8d216d9-b886-4d80-aac3-3906e689e76e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:01.627636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-8900d500-f125-41f9-b000-3ca131119809 req-b724ecd9-e7cc-44ce-80c3-53842c636274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5195b11-b310-408b-a3d8-75d39abd9bba", "name": "network-vif-plugged", "status": "completed", "tag": "8886c0e9-3f34-4a35-b75b-b420c97f524e"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:01.644040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-8900d500-f125-41f9-b000-3ca131119809 req-b724ecd9-e7cc-44ce-80c3-53842c636274 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:01.644040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-8900d500-f125-41f9-b000-3ca131119809 req-b724ecd9-e7cc-44ce-80c3-53842c636274 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:01.644661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-8900d500-f125-41f9-b000-3ca131119809 req-b724ecd9-e7cc-44ce-80c3-53842c636274 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:01.656474 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:01.660265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-8900d500-f125-41f9-b000-3ca131119809 req-b724ecd9-e7cc-44ce-80c3-53842c636274 service nova] Creating event network-vif-plugged:8886c0e9-3f34-4a35-b75b-b420c97f524e for instance a5195b11-b310-408b-a3d8-75d39abd9bba on hv-cinder-84496 Sep 14 12:07:01.666648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-8900d500-f125-41f9-b000-3ca131119809 req-b724ecd9-e7cc-44ce-80c3-53842c636274 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179095 Sep 14 12:07:01.667571 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 79/170] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:07:01.677528 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c911c89d-b433-48a4-86da-83f106c09deb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:01.679091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c911c89d-b433-48a4-86da-83f106c09deb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:01.685438 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c911c89d-b433-48a4-86da-83f106c09deb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:01.686045 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c911c89d-b433-48a4-86da-83f106c09deb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:01.686674 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c911c89d-b433-48a4-86da-83f106c09deb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:01.687568 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c911c89d-b433-48a4-86da-83f106c09deb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:01.688230 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c911c89d-b433-48a4-86da-83f106c09deb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:01.688829 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c911c89d-b433-48a4-86da-83f106c09deb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:02.171010 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b8d216d9-b886-4d80-aac3-3906e689e76e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:02.183427 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b8d216d9-b886-4d80-aac3-3906e689e76e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.618722 Sep 14 12:07:02.183805 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c911c89d-b433-48a4-86da-83f106c09deb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:02.184584 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 92/171] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:01 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:02.195682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c911c89d-b433-48a4-86da-83f106c09deb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.523114 Sep 14 12:07:02.197911 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 80/172] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:01 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:02.518612 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d85870a7-6065-4b1e-9eba-b01d61481fb1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:02.519554 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d85870a7-6065-4b1e-9eba-b01d61481fb1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:02.536973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d85870a7-6065-4b1e-9eba-b01d61481fb1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:02.542423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d85870a7-6065-4b1e-9eba-b01d61481fb1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:02.543284 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d85870a7-6065-4b1e-9eba-b01d61481fb1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:02.545018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d85870a7-6065-4b1e-9eba-b01d61481fb1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:02.545680 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d85870a7-6065-4b1e-9eba-b01d61481fb1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:02.547996 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d85870a7-6065-4b1e-9eba-b01d61481fb1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:02.597791 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:02.598723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:02.611159 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:02.615953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:02.615953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:02.615953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:02.615953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:02.616943 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:02.923380 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:02.944432 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:02.946206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:02.947627 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e951e619-d8c6-4f19-8ebc-601b30fd0e61 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.354524 Sep 14 12:07:02.947748 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d85870a7-6065-4b1e-9eba-b01d61481fb1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:02.959239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 81/173] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:02 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:07:02.965478 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d85870a7-6065-4b1e-9eba-b01d61481fb1 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.452538 Sep 14 12:07:02.966888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 93/174] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:02 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:03.054280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-97d959ec-bfa9-4327-b303-66ebcb5bf46f req-84466d1b-53c4-4af4-b6a6-1fde7a7f13ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ce41d2-7079-429c-a18a-de51b2c20e6b", "tag": "07ecea17-6958-4771-b1ae-f0ad902c21eb"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:03.065434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-97d959ec-bfa9-4327-b303-66ebcb5bf46f req-84466d1b-53c4-4af4-b6a6-1fde7a7f13ed service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:03.066249 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-97d959ec-bfa9-4327-b303-66ebcb5bf46f req-84466d1b-53c4-4af4-b6a6-1fde7a7f13ed service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:03.066671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-97d959ec-bfa9-4327-b303-66ebcb5bf46f req-84466d1b-53c4-4af4-b6a6-1fde7a7f13ed service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:03.079494 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-97d959ec-bfa9-4327-b303-66ebcb5bf46f req-84466d1b-53c4-4af4-b6a6-1fde7a7f13ed service nova] Creating event network-changed:07ecea17-6958-4771-b1ae-f0ad902c21eb for instance 76ce41d2-7079-429c-a18a-de51b2c20e6b on hv-cinder-84496 Sep 14 12:07:03.085069 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-97d959ec-bfa9-4327-b303-66ebcb5bf46f req-84466d1b-53c4-4af4-b6a6-1fde7a7f13ed service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035924 Sep 14 12:07:03.085934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 82/175] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:07:03.210978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5e722d2a-2c52-47da-9338-c8e9efe24541 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:03.212069 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5e722d2a-2c52-47da-9338-c8e9efe24541 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:03.221524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e722d2a-2c52-47da-9338-c8e9efe24541 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:03.229430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e722d2a-2c52-47da-9338-c8e9efe24541 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:03.229430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e722d2a-2c52-47da-9338-c8e9efe24541 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:03.229924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-37ff98cc-24d2-4331-bf83-22511fb5086a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:03.230019 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e722d2a-2c52-47da-9338-c8e9efe24541 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:03.230102 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-37ff98cc-24d2-4331-bf83-22511fb5086a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:03.230204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e722d2a-2c52-47da-9338-c8e9efe24541 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:03.230204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e722d2a-2c52-47da-9338-c8e9efe24541 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:03.232193 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37ff98cc-24d2-4331-bf83-22511fb5086a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:03.232747 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37ff98cc-24d2-4331-bf83-22511fb5086a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:03.233284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37ff98cc-24d2-4331-bf83-22511fb5086a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:03.234218 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37ff98cc-24d2-4331-bf83-22511fb5086a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:03.234904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37ff98cc-24d2-4331-bf83-22511fb5086a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:03.235988 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-37ff98cc-24d2-4331-bf83-22511fb5086a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:03.471889 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5e722d2a-2c52-47da-9338-c8e9efe24541 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:03.477820 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-37ff98cc-24d2-4331-bf83-22511fb5086a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:03.484227 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5e722d2a-2c52-47da-9338-c8e9efe24541 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.277266 Sep 14 12:07:03.491349 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 94/176] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:03 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:03.492369 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-37ff98cc-24d2-4331-bf83-22511fb5086a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.271164 Sep 14 12:07:03.492369 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 83/177] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:03 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:03.973314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:03.973951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:03.980065 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:03.980878 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:03.981324 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:03.982067 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:03.982527 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:03.982946 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:03.996460 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ef725691-1ad3-42df-a491-374389a08750 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:03.997055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ef725691-1ad3-42df-a491-374389a08750 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:04.003116 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef725691-1ad3-42df-a491-374389a08750 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:04.003653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef725691-1ad3-42df-a491-374389a08750 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:04.004099 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef725691-1ad3-42df-a491-374389a08750 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:04.004804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef725691-1ad3-42df-a491-374389a08750 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:04.005262 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef725691-1ad3-42df-a491-374389a08750 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:04.005691 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef725691-1ad3-42df-a491-374389a08750 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:04.212417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:04.220432 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ef725691-1ad3-42df-a491-374389a08750 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:04.221828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:04.223461 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:04.224862 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2ea547a2-92e8-45c3-b427-2a3aeb2559d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.256079 Sep 14 12:07:04.225626 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 95/178] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:03 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:07:04.232324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ef725691-1ad3-42df-a491-374389a08750 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.239464 Sep 14 12:07:04.232935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 84/179] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:03 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:04.508691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1c1484fd-e0f3-403e-b357-61923e02133c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:04.509332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1c1484fd-e0f3-403e-b357-61923e02133c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:04.516053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1484fd-e0f3-403e-b357-61923e02133c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:04.517102 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1484fd-e0f3-403e-b357-61923e02133c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:04.517540 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1484fd-e0f3-403e-b357-61923e02133c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:04.517641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-13c58409-024d-4a76-9a89-f1cfee173516 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:04.518222 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-13c58409-024d-4a76-9a89-f1cfee173516 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:04.518441 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1484fd-e0f3-403e-b357-61923e02133c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:04.519211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1484fd-e0f3-403e-b357-61923e02133c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:04.519639 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1484fd-e0f3-403e-b357-61923e02133c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:04.524812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13c58409-024d-4a76-9a89-f1cfee173516 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:04.525309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13c58409-024d-4a76-9a89-f1cfee173516 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:04.525751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13c58409-024d-4a76-9a89-f1cfee173516 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:04.526485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13c58409-024d-4a76-9a89-f1cfee173516 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:04.526935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13c58409-024d-4a76-9a89-f1cfee173516 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:04.527368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13c58409-024d-4a76-9a89-f1cfee173516 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:04.724749 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1c1484fd-e0f3-403e-b357-61923e02133c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:04.727466 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13c58409-024d-4a76-9a89-f1cfee173516 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:04.733572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1c1484fd-e0f3-403e-b357-61923e02133c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.229083 Sep 14 12:07:04.734180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 96/180] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:04 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:04.735775 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-13c58409-024d-4a76-9a89-f1cfee173516 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.223212 Sep 14 12:07:04.736819 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 85/181] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:04 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:05.259775 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c1d40287-7498-4722-b7b9-31915f6ee4d2 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:05.261237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c1d40287-7498-4722-b7b9-31915f6ee4d2 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:05.265574 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:05.266792 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:05.273297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d40287-7498-4722-b7b9-31915f6ee4d2 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:05.274015 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d40287-7498-4722-b7b9-31915f6ee4d2 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:05.275153 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d40287-7498-4722-b7b9-31915f6ee4d2 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:05.275906 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d40287-7498-4722-b7b9-31915f6ee4d2 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:05.276367 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d40287-7498-4722-b7b9-31915f6ee4d2 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:05.276798 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d40287-7498-4722-b7b9-31915f6ee4d2 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:05.285593 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:05.286162 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:05.286591 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:05.287288 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:05.287737 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:05.288151 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:05.484363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c1d40287-7498-4722-b7b9-31915f6ee4d2 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:05.489465 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:05.493459 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c1d40287-7498-4722-b7b9-31915f6ee4d2 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.241120 Sep 14 12:07:05.494285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 97/182] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:05 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:05.497675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:05.499153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:05.500336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-41c4ffc1-b288-41f4-971a-2ad8d60b5a27 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.238626 Sep 14 12:07:05.500939 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 86/183] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:05 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:07:05.759162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-28c22ba1-03ed-41b4-bac2-383287a8f064 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:05.759366 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3bb46866-2d8e-4aca-bf2b-cfe06d5b1dbb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:05.759679 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-28c22ba1-03ed-41b4-bac2-383287a8f064 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:05.759952 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3bb46866-2d8e-4aca-bf2b-cfe06d5b1dbb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:05.766040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28c22ba1-03ed-41b4-bac2-383287a8f064 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:05.766209 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bb46866-2d8e-4aca-bf2b-cfe06d5b1dbb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:05.767255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28c22ba1-03ed-41b4-bac2-383287a8f064 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:05.768014 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28c22ba1-03ed-41b4-bac2-383287a8f064 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:05.768213 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bb46866-2d8e-4aca-bf2b-cfe06d5b1dbb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:05.768795 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28c22ba1-03ed-41b4-bac2-383287a8f064 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:05.768910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bb46866-2d8e-4aca-bf2b-cfe06d5b1dbb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:05.769252 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28c22ba1-03ed-41b4-bac2-383287a8f064 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:05.769524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bb46866-2d8e-4aca-bf2b-cfe06d5b1dbb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:05.769770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28c22ba1-03ed-41b4-bac2-383287a8f064 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:05.770133 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bb46866-2d8e-4aca-bf2b-cfe06d5b1dbb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:05.770423 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bb46866-2d8e-4aca-bf2b-cfe06d5b1dbb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:05.986435 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-28c22ba1-03ed-41b4-bac2-383287a8f064 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:05.994163 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3bb46866-2d8e-4aca-bf2b-cfe06d5b1dbb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:05.995763 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-28c22ba1-03ed-41b4-bac2-383287a8f064 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.240383 Sep 14 12:07:05.996643 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 98/184] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:05 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:06.004135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3bb46866-2d8e-4aca-bf2b-cfe06d5b1dbb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.248600 Sep 14 12:07:06.005428 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 87/185] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:05 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:06.516198 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8434b128-c080-4439-b990-54db99363ffa tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:06.516997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8434b128-c080-4439-b990-54db99363ffa tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:06.523011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8434b128-c080-4439-b990-54db99363ffa tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:06.523498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8434b128-c080-4439-b990-54db99363ffa tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:06.523928 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8434b128-c080-4439-b990-54db99363ffa tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:06.524880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8434b128-c080-4439-b990-54db99363ffa tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:06.525655 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8434b128-c080-4439-b990-54db99363ffa tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:06.525764 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8434b128-c080-4439-b990-54db99363ffa tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:06.531292 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:06.532872 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:06.543432 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:06.544270 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:06.545040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:06.546440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:06.547233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:06.548569 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:06.747689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8434b128-c080-4439-b990-54db99363ffa tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:06.755831 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8434b128-c080-4439-b990-54db99363ffa tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.244011 Sep 14 12:07:06.757148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 99/186] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:06 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:06.764002 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:06.775246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:06.776972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:06.778064 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-90d95cd4-a91b-456a-8ac1-c4332d75cda0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.254894 Sep 14 12:07:06.778646 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 88/187] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:06 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:07:07.021063 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-02879b4c-2f1e-4dc1-bb28-2b39e580c22c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:07.021690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-02879b4c-2f1e-4dc1-bb28-2b39e580c22c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:07.028482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02879b4c-2f1e-4dc1-bb28-2b39e580c22c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:07.028963 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02879b4c-2f1e-4dc1-bb28-2b39e580c22c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:07.029150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d90e55e3-b607-4ccf-a7e4-ffde72c75ccd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:07.029385 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02879b4c-2f1e-4dc1-bb28-2b39e580c22c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:07.029653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d90e55e3-b607-4ccf-a7e4-ffde72c75ccd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:07.030222 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02879b4c-2f1e-4dc1-bb28-2b39e580c22c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:07.030666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02879b4c-2f1e-4dc1-bb28-2b39e580c22c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:07.031078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02879b4c-2f1e-4dc1-bb28-2b39e580c22c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:07.036393 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90e55e3-b607-4ccf-a7e4-ffde72c75ccd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:07.036883 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90e55e3-b607-4ccf-a7e4-ffde72c75ccd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:07.037318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90e55e3-b607-4ccf-a7e4-ffde72c75ccd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:07.038037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90e55e3-b607-4ccf-a7e4-ffde72c75ccd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:07.038487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90e55e3-b607-4ccf-a7e4-ffde72c75ccd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:07.038909 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90e55e3-b607-4ccf-a7e4-ffde72c75ccd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:07.714181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-02879b4c-2f1e-4dc1-bb28-2b39e580c22c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:07.727482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-02879b4c-2f1e-4dc1-bb28-2b39e580c22c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.708839 Sep 14 12:07:07.738352 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 100/188] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:07 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:07.781947 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d4f3a7c6-c7f4-4098-a479-c0bcc44f4dfb tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:07.782722 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d4f3a7c6-c7f4-4098-a479-c0bcc44f4dfb tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:07.789204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4f3a7c6-c7f4-4098-a479-c0bcc44f4dfb tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:07.798022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4f3a7c6-c7f4-4098-a479-c0bcc44f4dfb tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:07.802896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4f3a7c6-c7f4-4098-a479-c0bcc44f4dfb tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:07.808975 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4f3a7c6-c7f4-4098-a479-c0bcc44f4dfb tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:07.809654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4f3a7c6-c7f4-4098-a479-c0bcc44f4dfb tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:07.813934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d4f3a7c6-c7f4-4098-a479-c0bcc44f4dfb tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:07.856207 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d90e55e3-b607-4ccf-a7e4-ffde72c75ccd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:07.870134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d90e55e3-b607-4ccf-a7e4-ffde72c75ccd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.840844 Sep 14 12:07:07.872840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 89/189] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:07 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:07.895941 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:07.898867 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:07.910581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:07.911116 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:07.911559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:07.912280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:07.919768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:07.920635 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:08.143938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d4f3a7c6-c7f4-4098-a479-c0bcc44f4dfb tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:08.145526 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:08.155019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:08.157615 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:08.158779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f0326a66-a711-47c6-90fa-b20648d326f6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.275899 Sep 14 12:07:08.160042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 90/190] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:07 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:07:08.162144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d4f3a7c6-c7f4-4098-a479-c0bcc44f4dfb tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.384407 Sep 14 12:07:08.162721 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 101/191] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:07 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:08.760859 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-521a703d-91f6-408e-a5a7-b8ffa86ed708 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:08.761478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-521a703d-91f6-408e-a5a7-b8ffa86ed708 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:08.768594 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-521a703d-91f6-408e-a5a7-b8ffa86ed708 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:08.769092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-521a703d-91f6-408e-a5a7-b8ffa86ed708 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:08.769533 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-521a703d-91f6-408e-a5a7-b8ffa86ed708 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:08.770276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-521a703d-91f6-408e-a5a7-b8ffa86ed708 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:08.770787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-521a703d-91f6-408e-a5a7-b8ffa86ed708 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:08.771445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-521a703d-91f6-408e-a5a7-b8ffa86ed708 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:08.898934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b270ead3-e254-422b-bbd1-4cbb7f81ff23 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:08.899806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b270ead3-e254-422b-bbd1-4cbb7f81ff23 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:08.908720 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b270ead3-e254-422b-bbd1-4cbb7f81ff23 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:08.909582 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b270ead3-e254-422b-bbd1-4cbb7f81ff23 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:08.910277 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b270ead3-e254-422b-bbd1-4cbb7f81ff23 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:08.910999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b270ead3-e254-422b-bbd1-4cbb7f81ff23 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:08.911813 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b270ead3-e254-422b-bbd1-4cbb7f81ff23 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:08.912565 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b270ead3-e254-422b-bbd1-4cbb7f81ff23 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:09.075354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-521a703d-91f6-408e-a5a7-b8ffa86ed708 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:09.089546 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-521a703d-91f6-408e-a5a7-b8ffa86ed708 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.332855 Sep 14 12:07:09.090404 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 91/192] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:08 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:09.153401 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b270ead3-e254-422b-bbd1-4cbb7f81ff23 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:09.163738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b270ead3-e254-422b-bbd1-4cbb7f81ff23 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.268930 Sep 14 12:07:09.164321 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 102/193] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:08 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:09.196082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:09.196929 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:09.199883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bc2edc33-2c83-4c3c-a272-6a9ecb749c61 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:09.200913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-bc2edc33-2c83-4c3c-a272-6a9ecb749c61 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:09.208999 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:09.217553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:09.217553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:09.217553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:09.217553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:09.218395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:09.218482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc2edc33-2c83-4c3c-a272-6a9ecb749c61 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:09.218482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc2edc33-2c83-4c3c-a272-6a9ecb749c61 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:09.218482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc2edc33-2c83-4c3c-a272-6a9ecb749c61 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:09.218482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc2edc33-2c83-4c3c-a272-6a9ecb749c61 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:09.218790 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc2edc33-2c83-4c3c-a272-6a9ecb749c61 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:09.218790 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc2edc33-2c83-4c3c-a272-6a9ecb749c61 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:09.504354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bc2edc33-2c83-4c3c-a272-6a9ecb749c61 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:09.510610 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:09.511254 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:09.520999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bc2edc33-2c83-4c3c-a272-6a9ecb749c61 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.325583 Sep 14 12:07:09.521144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:09.531715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 103/194] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:09 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:09.531904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:09.531904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b6499a76-61b2-4d39-b409-b3be84b7dce4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.340349 Sep 14 12:07:09.531904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 92/195] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:09 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:07:10.116767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-df756db9-183e-4bfd-aab8-df5657be34e9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:10.117389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-df756db9-183e-4bfd-aab8-df5657be34e9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:10.128163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df756db9-183e-4bfd-aab8-df5657be34e9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:10.128660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df756db9-183e-4bfd-aab8-df5657be34e9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:10.129092 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df756db9-183e-4bfd-aab8-df5657be34e9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:10.130782 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df756db9-183e-4bfd-aab8-df5657be34e9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:10.131950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df756db9-183e-4bfd-aab8-df5657be34e9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:10.132431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df756db9-183e-4bfd-aab8-df5657be34e9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:10.188816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-93e7905a-0b5d-4239-987c-5ddbdb2b4c8f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:10.189436 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-93e7905a-0b5d-4239-987c-5ddbdb2b4c8f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:10.195709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-93e7905a-0b5d-4239-987c-5ddbdb2b4c8f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:10.196196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-93e7905a-0b5d-4239-987c-5ddbdb2b4c8f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:10.196720 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-93e7905a-0b5d-4239-987c-5ddbdb2b4c8f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:10.197487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-93e7905a-0b5d-4239-987c-5ddbdb2b4c8f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:10.198070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-93e7905a-0b5d-4239-987c-5ddbdb2b4c8f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:10.198490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-93e7905a-0b5d-4239-987c-5ddbdb2b4c8f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:10.381268 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-df756db9-183e-4bfd-aab8-df5657be34e9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:10.422128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-df756db9-183e-4bfd-aab8-df5657be34e9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.309400 Sep 14 12:07:10.427716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 104/196] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:10 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:10.457111 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-93e7905a-0b5d-4239-987c-5ddbdb2b4c8f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:10.472305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-93e7905a-0b5d-4239-987c-5ddbdb2b4c8f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.285708 Sep 14 12:07:10.474029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 93/197] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:10 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:10.483670 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-71b795bc-e3f6-48a2-a9a7-8bd5eb77b7f0 req-a00304ae-524a-4c4e-bbe5-f532d2b54a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7649ff4f-2137-402c-a210-b4b9f4c95b82", "name": "network-vif-plugged", "status": "completed", "tag": "1284ee63-88b4-458d-ab2c-4d6fca36d2a1"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:10.498336 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-71b795bc-e3f6-48a2-a9a7-8bd5eb77b7f0 req-a00304ae-524a-4c4e-bbe5-f532d2b54a66 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:10.502689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-71b795bc-e3f6-48a2-a9a7-8bd5eb77b7f0 req-a00304ae-524a-4c4e-bbe5-f532d2b54a66 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:10.502689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-71b795bc-e3f6-48a2-a9a7-8bd5eb77b7f0 req-a00304ae-524a-4c4e-bbe5-f532d2b54a66 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:10.511778 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-71b795bc-e3f6-48a2-a9a7-8bd5eb77b7f0 req-a00304ae-524a-4c4e-bbe5-f532d2b54a66 service nova] Creating event network-vif-plugged:1284ee63-88b4-458d-ab2c-4d6fca36d2a1 for instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 on hv-cinder-84496 Sep 14 12:07:10.518853 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-71b795bc-e3f6-48a2-a9a7-8bd5eb77b7f0 req-a00304ae-524a-4c4e-bbe5-f532d2b54a66 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039282 Sep 14 12:07:10.520060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 105/198] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:07:10.547722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cb9cc371-a00b-468b-a500-9310c92fc459 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:10.548493 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cb9cc371-a00b-468b-a500-9310c92fc459 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:10.558725 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb9cc371-a00b-468b-a500-9310c92fc459 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:10.559440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb9cc371-a00b-468b-a500-9310c92fc459 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:10.560880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb9cc371-a00b-468b-a500-9310c92fc459 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:10.562202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb9cc371-a00b-468b-a500-9310c92fc459 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:10.563688 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb9cc371-a00b-468b-a500-9310c92fc459 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:10.564544 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cb9cc371-a00b-468b-a500-9310c92fc459 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:10.571881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:10.571881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:10.580866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:10.583454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:10.584741 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:10.587022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:10.587656 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:10.589059 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:10.872434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cb9cc371-a00b-468b-a500-9310c92fc459 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:10.872970 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:10.882046 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cb9cc371-a00b-468b-a500-9310c92fc459 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.338684 Sep 14 12:07:10.882728 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 94/199] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:10 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:10.883883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:10.885461 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:10.886806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-aed7720e-f5bf-4a95-aad5-48c0a629f6fd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.327172 Sep 14 12:07:10.889845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 106/200] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:10 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:07:11.454802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f47133ac-66f2-48e6-9dc0-18f3e0fd6145 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:11.455924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f47133ac-66f2-48e6-9dc0-18f3e0fd6145 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:11.462982 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f47133ac-66f2-48e6-9dc0-18f3e0fd6145 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:11.463476 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f47133ac-66f2-48e6-9dc0-18f3e0fd6145 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:11.470403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f47133ac-66f2-48e6-9dc0-18f3e0fd6145 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:11.470403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f47133ac-66f2-48e6-9dc0-18f3e0fd6145 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:11.470403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f47133ac-66f2-48e6-9dc0-18f3e0fd6145 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:11.470403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f47133ac-66f2-48e6-9dc0-18f3e0fd6145 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:11.504604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7c9d3a1c-fdea-4c6a-801e-8ed105f03945 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:11.505262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7c9d3a1c-fdea-4c6a-801e-8ed105f03945 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:11.519120 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c9d3a1c-fdea-4c6a-801e-8ed105f03945 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:11.521029 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c9d3a1c-fdea-4c6a-801e-8ed105f03945 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:11.521732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c9d3a1c-fdea-4c6a-801e-8ed105f03945 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:11.523823 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c9d3a1c-fdea-4c6a-801e-8ed105f03945 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:11.525209 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c9d3a1c-fdea-4c6a-801e-8ed105f03945 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:11.526632 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c9d3a1c-fdea-4c6a-801e-8ed105f03945 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:11.838724 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f47133ac-66f2-48e6-9dc0-18f3e0fd6145 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:11.847473 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f47133ac-66f2-48e6-9dc0-18f3e0fd6145 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.401098 Sep 14 12:07:11.847976 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 95/201] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:11 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:11.851546 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7c9d3a1c-fdea-4c6a-801e-8ed105f03945 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:11.862535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7c9d3a1c-fdea-4c6a-801e-8ed105f03945 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.363321 Sep 14 12:07:11.873462 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 107/202] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:11 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:11.906221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9e4ad9f6-3005-4891-b732-3a7644b75d20 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:11.906887 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9e4ad9f6-3005-4891-b732-3a7644b75d20 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:11.914287 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e4ad9f6-3005-4891-b732-3a7644b75d20 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:11.914789 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e4ad9f6-3005-4891-b732-3a7644b75d20 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:11.915404 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e4ad9f6-3005-4891-b732-3a7644b75d20 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:11.916271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e4ad9f6-3005-4891-b732-3a7644b75d20 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:11.916890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e4ad9f6-3005-4891-b732-3a7644b75d20 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:11.917480 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9e4ad9f6-3005-4891-b732-3a7644b75d20 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:11.922684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:11.927401 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:11.937556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:11.940317 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:11.948273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:11.948273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:11.948273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:11.948273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:12.221255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9e4ad9f6-3005-4891-b732-3a7644b75d20 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:12.229150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9e4ad9f6-3005-4891-b732-3a7644b75d20 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.326793 Sep 14 12:07:12.244806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 96/203] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:11 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:12.279264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:12.289926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:12.291914 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:12.293573 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1e421d76-e1d6-4a8a-8b95-721a003381cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.384376 Sep 14 12:07:12.294212 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 108/204] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:11 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:07:12.871971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4be20afb-894e-4355-9152-c1e49c05a5fe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:12.872540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4be20afb-894e-4355-9152-c1e49c05a5fe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:12.879279 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4be20afb-894e-4355-9152-c1e49c05a5fe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:12.879765 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4be20afb-894e-4355-9152-c1e49c05a5fe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:12.880369 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4be20afb-894e-4355-9152-c1e49c05a5fe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:12.881598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4be20afb-894e-4355-9152-c1e49c05a5fe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:12.881598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4be20afb-894e-4355-9152-c1e49c05a5fe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:12.882238 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4be20afb-894e-4355-9152-c1e49c05a5fe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:12.886950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:12.891172 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f5e5dfb0-5d4c-4112-b916-a29a1bf3fcd5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:12.892242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f5e5dfb0-5d4c-4112-b916-a29a1bf3fcd5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:12.902449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5e5dfb0-5d4c-4112-b916-a29a1bf3fcd5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:12.903554 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5e5dfb0-5d4c-4112-b916-a29a1bf3fcd5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:12.903818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5e5dfb0-5d4c-4112-b916-a29a1bf3fcd5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:12.905254 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5e5dfb0-5d4c-4112-b916-a29a1bf3fcd5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:12.906352 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5e5dfb0-5d4c-4112-b916-a29a1bf3fcd5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:12.907326 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5e5dfb0-5d4c-4112-b916-a29a1bf3fcd5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:13.129628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4be20afb-894e-4355-9152-c1e49c05a5fe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:13.133503 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f5e5dfb0-5d4c-4112-b916-a29a1bf3fcd5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:13.138590 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4be20afb-894e-4355-9152-c1e49c05a5fe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.271385 Sep 14 12:07:13.139392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 97/205] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:12 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:13.161391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f5e5dfb0-5d4c-4112-b916-a29a1bf3fcd5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.277926 Sep 14 12:07:13.162189 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 109/206] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:12 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:13.252423 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-129beaaf-139e-4ffc-8d16-e0a944598299 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:13.253137 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-129beaaf-139e-4ffc-8d16-e0a944598299 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:13.259353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-129beaaf-139e-4ffc-8d16-e0a944598299 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:13.259930 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-129beaaf-139e-4ffc-8d16-e0a944598299 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:13.260440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-129beaaf-139e-4ffc-8d16-e0a944598299 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:13.261216 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-129beaaf-139e-4ffc-8d16-e0a944598299 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:13.261677 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-129beaaf-139e-4ffc-8d16-e0a944598299 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:13.262193 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-129beaaf-139e-4ffc-8d16-e0a944598299 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:13.336236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:13.336835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:13.342905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:13.343401 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:13.343857 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:13.345820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:13.345820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:13.345820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:13.461291 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-129beaaf-139e-4ffc-8d16-e0a944598299 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:13.482588 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-129beaaf-139e-4ffc-8d16-e0a944598299 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.233938 Sep 14 12:07:13.483279 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 98/207] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:13 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:13.566455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:13.574671 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:13.576098 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:13.577192 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2278aa51-21df-4396-9a80-fd15a2777aef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.245413 Sep 14 12:07:13.577752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 110/208] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:13 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:07:14.164588 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0e556813-b936-418c-82cf-f228e9077c8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:14.165361 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0e556813-b936-418c-82cf-f228e9077c8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:14.171363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e556813-b936-418c-82cf-f228e9077c8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:14.172888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e556813-b936-418c-82cf-f228e9077c8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:14.172888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e556813-b936-418c-82cf-f228e9077c8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:14.173499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e556813-b936-418c-82cf-f228e9077c8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:14.174021 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e556813-b936-418c-82cf-f228e9077c8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:14.174420 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e556813-b936-418c-82cf-f228e9077c8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:14.185290 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7ae7c2a2-3620-48bd-b74a-4bbb82c9869e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:14.186164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7ae7c2a2-3620-48bd-b74a-4bbb82c9869e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:14.192502 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7ae7c2a2-3620-48bd-b74a-4bbb82c9869e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:14.193637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7ae7c2a2-3620-48bd-b74a-4bbb82c9869e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:14.193637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7ae7c2a2-3620-48bd-b74a-4bbb82c9869e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:14.194205 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7ae7c2a2-3620-48bd-b74a-4bbb82c9869e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:14.194820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7ae7c2a2-3620-48bd-b74a-4bbb82c9869e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:14.195386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7ae7c2a2-3620-48bd-b74a-4bbb82c9869e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:14.381633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0e556813-b936-418c-82cf-f228e9077c8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:14.391361 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0e556813-b936-418c-82cf-f228e9077c8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.230975 Sep 14 12:07:14.392434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 99/209] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:14 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:14.419460 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7ae7c2a2-3620-48bd-b74a-4bbb82c9869e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:14.427764 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7ae7c2a2-3620-48bd-b74a-4bbb82c9869e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.246919 Sep 14 12:07:14.428333 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 111/210] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:14 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:14.504796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bee697d6-7ed9-4988-bdae-0e738c52c5b5 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:14.506877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bee697d6-7ed9-4988-bdae-0e738c52c5b5 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:14.511763 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bee697d6-7ed9-4988-bdae-0e738c52c5b5 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:14.512324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bee697d6-7ed9-4988-bdae-0e738c52c5b5 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:14.512722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bee697d6-7ed9-4988-bdae-0e738c52c5b5 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:14.513425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bee697d6-7ed9-4988-bdae-0e738c52c5b5 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:14.513872 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bee697d6-7ed9-4988-bdae-0e738c52c5b5 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:14.514299 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bee697d6-7ed9-4988-bdae-0e738c52c5b5 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:14.601697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:14.602348 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:14.609570 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:14.612420 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:14.612420 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:14.612420 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:14.612420 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:14.612791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:14.691732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bee697d6-7ed9-4988-bdae-0e738c52c5b5 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:14.708999 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bee697d6-7ed9-4988-bdae-0e738c52c5b5 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.207748 Sep 14 12:07:14.713926 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 100/211] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:14 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:14.774628 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:14.783661 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:14.785098 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:14.786278 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-07fbd203-739c-4675-8df0-38ba3d8de708 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.188341 Sep 14 12:07:14.786856 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 112/212] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:14 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:07:15.115755 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-72b59acd-3b66-447e-83e4-c39851f15198 req-0920a7d0-75cd-480d-9aa8-5ba560d03df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b1312a-8b45-4481-9a44-f330379d0c8f", "name": "network-vif-plugged", "status": "completed", "tag": "906fb0c9-14b7-4949-943a-c084b122ae8b"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:15.128785 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-72b59acd-3b66-447e-83e4-c39851f15198 req-0920a7d0-75cd-480d-9aa8-5ba560d03df8 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:15.129421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-72b59acd-3b66-447e-83e4-c39851f15198 req-0920a7d0-75cd-480d-9aa8-5ba560d03df8 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:15.130344 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-72b59acd-3b66-447e-83e4-c39851f15198 req-0920a7d0-75cd-480d-9aa8-5ba560d03df8 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:15.152918 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-72b59acd-3b66-447e-83e4-c39851f15198 req-0920a7d0-75cd-480d-9aa8-5ba560d03df8 service nova] Creating event network-vif-plugged:906fb0c9-14b7-4949-943a-c084b122ae8b for instance b7b1312a-8b45-4481-9a44-f330379d0c8f on hv-cinder-84496 Sep 14 12:07:15.159655 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-72b59acd-3b66-447e-83e4-c39851f15198 req-0920a7d0-75cd-480d-9aa8-5ba560d03df8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050935 Sep 14 12:07:15.160514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 101/213] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:07:15.416845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-df209a4f-6c43-44f3-9366-8db324da3194 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:15.418165 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-df209a4f-6c43-44f3-9366-8db324da3194 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:15.425145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df209a4f-6c43-44f3-9366-8db324da3194 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:15.426012 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df209a4f-6c43-44f3-9366-8db324da3194 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:15.426611 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df209a4f-6c43-44f3-9366-8db324da3194 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:15.427549 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df209a4f-6c43-44f3-9366-8db324da3194 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:15.428168 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df209a4f-6c43-44f3-9366-8db324da3194 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:15.428776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-df209a4f-6c43-44f3-9366-8db324da3194 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:15.458002 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1cb594ca-01ed-45f7-80f7-ab3971a6faf7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:15.460066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1cb594ca-01ed-45f7-80f7-ab3971a6faf7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:15.478160 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1cb594ca-01ed-45f7-80f7-ab3971a6faf7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:15.478830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1cb594ca-01ed-45f7-80f7-ab3971a6faf7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:15.480168 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1cb594ca-01ed-45f7-80f7-ab3971a6faf7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:15.481214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1cb594ca-01ed-45f7-80f7-ab3971a6faf7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:15.481849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1cb594ca-01ed-45f7-80f7-ab3971a6faf7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:15.482477 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1cb594ca-01ed-45f7-80f7-ab3971a6faf7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:16.026303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-df209a4f-6c43-44f3-9366-8db324da3194 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:16.039445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1cb594ca-01ed-45f7-80f7-ab3971a6faf7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:16.044046 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-df209a4f-6c43-44f3-9366-8db324da3194 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.631548 Sep 14 12:07:16.044275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 113/214] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:15 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:16.049475 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-42366cbc-b995-43f3-ae02-cdda2eb266e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:16.050113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-42366cbc-b995-43f3-ae02-cdda2eb266e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:16.064623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1cb594ca-01ed-45f7-80f7-ab3971a6faf7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.617028 Sep 14 12:07:16.065783 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-42366cbc-b995-43f3-ae02-cdda2eb266e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:16.066838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 102/215] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:15 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:16.067752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-42366cbc-b995-43f3-ae02-cdda2eb266e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:16.068376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-42366cbc-b995-43f3-ae02-cdda2eb266e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:16.074814 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-42366cbc-b995-43f3-ae02-cdda2eb266e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:16.075982 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-42366cbc-b995-43f3-ae02-cdda2eb266e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:16.077171 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-42366cbc-b995-43f3-ae02-cdda2eb266e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:16.087448 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:16.088687 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:16.102064 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:16.103163 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:16.104370 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:16.105829 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:16.106692 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:16.107978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:16.388294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-42366cbc-b995-43f3-ae02-cdda2eb266e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:16.402688 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-42366cbc-b995-43f3-ae02-cdda2eb266e3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1314 microversion: 2.1 time: 0.357340 Sep 14 12:07:16.403300 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 114/216] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:16 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:16.408514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:16.416869 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:16.418340 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:16.419682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8827550b-c20f-473d-8992-c0050293b50e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.350071 Sep 14 12:07:16.420785 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 103/217] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:16 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:07:17.072914 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-25101d24-544d-4dcb-be85-4f5280dd7d6b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:17.073580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-25101d24-544d-4dcb-be85-4f5280dd7d6b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:17.081596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25101d24-544d-4dcb-be85-4f5280dd7d6b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:17.082398 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25101d24-544d-4dcb-be85-4f5280dd7d6b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:17.084697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25101d24-544d-4dcb-be85-4f5280dd7d6b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:17.085838 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25101d24-544d-4dcb-be85-4f5280dd7d6b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:17.086535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25101d24-544d-4dcb-be85-4f5280dd7d6b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:17.087170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25101d24-544d-4dcb-be85-4f5280dd7d6b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:17.095562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d57e875a-86d7-487d-8072-b89f2e853d72 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:17.097487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d57e875a-86d7-487d-8072-b89f2e853d72 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:17.110748 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d57e875a-86d7-487d-8072-b89f2e853d72 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:17.112535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d57e875a-86d7-487d-8072-b89f2e853d72 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:17.113936 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d57e875a-86d7-487d-8072-b89f2e853d72 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:17.115019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d57e875a-86d7-487d-8072-b89f2e853d72 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:17.117040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d57e875a-86d7-487d-8072-b89f2e853d72 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:17.118299 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d57e875a-86d7-487d-8072-b89f2e853d72 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:17.344978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-25101d24-544d-4dcb-be85-4f5280dd7d6b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:17.354362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-25101d24-544d-4dcb-be85-4f5280dd7d6b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.285312 Sep 14 12:07:17.355851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 115/218] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:17 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:17.388056 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d57e875a-86d7-487d-8072-b89f2e853d72 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:17.398249 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d57e875a-86d7-487d-8072-b89f2e853d72 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.312265 Sep 14 12:07:17.399049 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 104/219] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:17 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:17.432652 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b08ba13a-5a7e-4712-980e-1cf6e4d734dc tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:17.433365 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b08ba13a-5a7e-4712-980e-1cf6e4d734dc tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:17.442505 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b08ba13a-5a7e-4712-980e-1cf6e4d734dc tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:17.443310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b08ba13a-5a7e-4712-980e-1cf6e4d734dc tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:17.443925 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b08ba13a-5a7e-4712-980e-1cf6e4d734dc tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:17.444832 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b08ba13a-5a7e-4712-980e-1cf6e4d734dc tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:17.445169 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:17.445699 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b08ba13a-5a7e-4712-980e-1cf6e4d734dc tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:17.445805 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:17.446489 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b08ba13a-5a7e-4712-980e-1cf6e4d734dc tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:17.470614 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:17.471135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:17.471579 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:17.472295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:17.472748 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:17.473173 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:18.043916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:18.058764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:18.060246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:18.061396 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-40b89247-059f-48cc-ab60-73a4f9eb401d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.620383 Sep 14 12:07:18.061998 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 105/220] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:17 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:07:18.082491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b08ba13a-5a7e-4712-980e-1cf6e4d734dc tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:18.092622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b08ba13a-5a7e-4712-980e-1cf6e4d734dc tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1501 microversion: 2.1 time: 0.663779 Sep 14 12:07:18.093389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 116/221] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:17 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1501 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:18.384244 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1a80d11a-8493-4661-b041-537c2e184e81 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:18.385112 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1a80d11a-8493-4661-b041-537c2e184e81 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:18.393696 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a80d11a-8493-4661-b041-537c2e184e81 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:18.395355 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a80d11a-8493-4661-b041-537c2e184e81 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:18.395355 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a80d11a-8493-4661-b041-537c2e184e81 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:18.395699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a80d11a-8493-4661-b041-537c2e184e81 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:18.398026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a80d11a-8493-4661-b041-537c2e184e81 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:18.398026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a80d11a-8493-4661-b041-537c2e184e81 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:18.421961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c93d27bf-e402-484c-ab01-a29bcd067e4e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:18.422979 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c93d27bf-e402-484c-ab01-a29bcd067e4e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:18.435508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c93d27bf-e402-484c-ab01-a29bcd067e4e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:18.443245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c93d27bf-e402-484c-ab01-a29bcd067e4e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:18.445826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c93d27bf-e402-484c-ab01-a29bcd067e4e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:18.446902 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c93d27bf-e402-484c-ab01-a29bcd067e4e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:18.448827 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c93d27bf-e402-484c-ab01-a29bcd067e4e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:18.449320 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c93d27bf-e402-484c-ab01-a29bcd067e4e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:18.943892 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1a80d11a-8493-4661-b041-537c2e184e81 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:18.952605 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1a80d11a-8493-4661-b041-537c2e184e81 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.574744 Sep 14 12:07:18.954773 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 106/222] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:18 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:18.988407 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c93d27bf-e402-484c-ab01-a29bcd067e4e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:19.001377 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c93d27bf-e402-484c-ab01-a29bcd067e4e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.584034 Sep 14 12:07:19.016249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 117/223] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:18 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:19.089728 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:19.090442 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:19.123150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:19.123719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:19.124092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:19.124827 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:19.125408 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:19.125835 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:19.359541 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:19.371767 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:19.373748 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:19.375819 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-21d7c7c2-aa92-447d-9775-a8d87bcabd67 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1406 microversion: 2.20 time: 0.292514 Sep 14 12:07:19.376830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 107/224] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:19 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:07:19.628746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-4eef8603-87b4-45cc-9e40-20964c7731e2 req-4ce904b2-a19e-4183-8906-a5a12486bae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f808ebd-698e-480a-9eac-4ef62bcc2b7b", "name": "network-vif-plugged", "status": "completed", "tag": "de5f0781-b564-4893-84ac-ebcb69c0ddc9"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:19.645045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-4eef8603-87b4-45cc-9e40-20964c7731e2 req-4ce904b2-a19e-4183-8906-a5a12486bae6 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:19.645709 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-4eef8603-87b4-45cc-9e40-20964c7731e2 req-4ce904b2-a19e-4183-8906-a5a12486bae6 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:19.646166 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-4eef8603-87b4-45cc-9e40-20964c7731e2 req-4ce904b2-a19e-4183-8906-a5a12486bae6 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:19.659762 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-4eef8603-87b4-45cc-9e40-20964c7731e2 req-4ce904b2-a19e-4183-8906-a5a12486bae6 service nova] Creating event network-vif-plugged:de5f0781-b564-4893-84ac-ebcb69c0ddc9 for instance 3f808ebd-698e-480a-9eac-4ef62bcc2b7b on hv-cinder-84496 Sep 14 12:07:19.666128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-4eef8603-87b4-45cc-9e40-20964c7731e2 req-4ce904b2-a19e-4183-8906-a5a12486bae6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043606 Sep 14 12:07:19.666965 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 118/225] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:07:19.981434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4386907b-cd44-4b90-8039-141bf6038004 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:19.982228 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4386907b-cd44-4b90-8039-141bf6038004 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:19.988595 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4386907b-cd44-4b90-8039-141bf6038004 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:19.989221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4386907b-cd44-4b90-8039-141bf6038004 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:19.989726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4386907b-cd44-4b90-8039-141bf6038004 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:19.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4386907b-cd44-4b90-8039-141bf6038004 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:19.991078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4386907b-cd44-4b90-8039-141bf6038004 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:19.991502 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4386907b-cd44-4b90-8039-141bf6038004 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:20.029799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-13a93f88-05a2-4d2f-aa4a-55594746be21 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:20.031150 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-13a93f88-05a2-4d2f-aa4a-55594746be21 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:20.038648 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13a93f88-05a2-4d2f-aa4a-55594746be21 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:20.039368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13a93f88-05a2-4d2f-aa4a-55594746be21 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:20.039804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13a93f88-05a2-4d2f-aa4a-55594746be21 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:20.040838 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13a93f88-05a2-4d2f-aa4a-55594746be21 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:20.041978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13a93f88-05a2-4d2f-aa4a-55594746be21 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:20.042417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13a93f88-05a2-4d2f-aa4a-55594746be21 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:20.274828 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4386907b-cd44-4b90-8039-141bf6038004 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:20.287300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4386907b-cd44-4b90-8039-141bf6038004 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.309719 Sep 14 12:07:20.289280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 108/226] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:19 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:20.315916 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-13a93f88-05a2-4d2f-aa4a-55594746be21 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:20.324900 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-13a93f88-05a2-4d2f-aa4a-55594746be21 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.300693 Sep 14 12:07:20.326105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 119/227] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:20 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:20.405233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:20.406876 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:20.413649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:20.414417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:20.414850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:20.415540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:20.416174 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:20.416869 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:20.584862 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:20.595465 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:20.596920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:20.598189 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5317fbca-08bf-46fb-89ba-3d458db4e599 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1598 microversion: 2.20 time: 0.197432 Sep 14 12:07:20.610093 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 109/228] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:07:20 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1598 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:07:20.630585 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9251db15-a44e-4033-8eca-2e54e8b52289 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:20.631561 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9251db15-a44e-4033-8eca-2e54e8b52289 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:20.638816 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9251db15-a44e-4033-8eca-2e54e8b52289 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:20.639388 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9251db15-a44e-4033-8eca-2e54e8b52289 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:20.639826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9251db15-a44e-4033-8eca-2e54e8b52289 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:20.640676 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9251db15-a44e-4033-8eca-2e54e8b52289 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:20.641264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9251db15-a44e-4033-8eca-2e54e8b52289 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:20.646090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9251db15-a44e-4033-8eca-2e54e8b52289 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:20.783951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9251db15-a44e-4033-8eca-2e54e8b52289 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.159713 Sep 14 12:07:20.786540 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 120/229] 10.222.0.62 () {60 vars in 1316 bytes} [Wed Sep 14 12:07:20 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:07:21.294192 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-256c78ed-5bd9-4d2b-82ea-422e0e363749 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "777fd023-37f5-41a7-b6c4-2d73075c1ec4"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:21.297398 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-256c78ed-5bd9-4d2b-82ea-422e0e363749 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:21.304390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256c78ed-5bd9-4d2b-82ea-422e0e363749 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:21.305022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256c78ed-5bd9-4d2b-82ea-422e0e363749 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:21.305770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256c78ed-5bd9-4d2b-82ea-422e0e363749 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:21.306584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256c78ed-5bd9-4d2b-82ea-422e0e363749 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:21.307050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256c78ed-5bd9-4d2b-82ea-422e0e363749 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:21.307478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256c78ed-5bd9-4d2b-82ea-422e0e363749 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:21.313218 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-620118f5-7f63-49c5-9a18-d8f7c8230a48 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:21.317070 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-620118f5-7f63-49c5-9a18-d8f7c8230a48 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:21.331934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-620118f5-7f63-49c5-9a18-d8f7c8230a48 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:21.332436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-620118f5-7f63-49c5-9a18-d8f7c8230a48 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:21.332905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-620118f5-7f63-49c5-9a18-d8f7c8230a48 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:21.333619 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-620118f5-7f63-49c5-9a18-d8f7c8230a48 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:21.334211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-620118f5-7f63-49c5-9a18-d8f7c8230a48 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:21.334869 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-620118f5-7f63-49c5-9a18-d8f7c8230a48 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:21.752654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-620118f5-7f63-49c5-9a18-d8f7c8230a48 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:21.780661 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-620118f5-7f63-49c5-9a18-d8f7c8230a48 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.455361 Sep 14 12:07:21.782840 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 121/230] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:21 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:21.787750 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b4f9953e-11dd-41c8-a428-a2834a8487fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:21.798205 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b4f9953e-11dd-41c8-a428-a2834a8487fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:21.801307 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4f9953e-11dd-41c8-a428-a2834a8487fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:21.802237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4f9953e-11dd-41c8-a428-a2834a8487fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:21.802941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4f9953e-11dd-41c8-a428-a2834a8487fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:21.803863 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4f9953e-11dd-41c8-a428-a2834a8487fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:21.804783 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4f9953e-11dd-41c8-a428-a2834a8487fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:21.805747 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4f9953e-11dd-41c8-a428-a2834a8487fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:21.812163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:22.002477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b4f9953e-11dd-41c8-a428-a2834a8487fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:22.002477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b4f9953e-11dd-41c8-a428-a2834a8487fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.203723 Sep 14 12:07:22.002477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 122/231] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:21 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:22.607454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-91fe1461-f742-4046-a7f2-36b19dd81dc5 req-0f87a237-9d5e-403d-bdd4-61b76cb65cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b1312a-8b45-4481-9a44-f330379d0c8f", "tag": "906fb0c9-14b7-4949-943a-c084b122ae8b"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:22.618087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-91fe1461-f742-4046-a7f2-36b19dd81dc5 req-0f87a237-9d5e-403d-bdd4-61b76cb65cfb service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:22.618705 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-91fe1461-f742-4046-a7f2-36b19dd81dc5 req-0f87a237-9d5e-403d-bdd4-61b76cb65cfb service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:22.618991 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-91fe1461-f742-4046-a7f2-36b19dd81dc5 req-0f87a237-9d5e-403d-bdd4-61b76cb65cfb service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:22.642975 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-91fe1461-f742-4046-a7f2-36b19dd81dc5 req-0f87a237-9d5e-403d-bdd4-61b76cb65cfb service nova] Creating event network-changed:906fb0c9-14b7-4949-943a-c084b122ae8b for instance b7b1312a-8b45-4481-9a44-f330379d0c8f on hv-cinder-84496 Sep 14 12:07:22.648668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-91fe1461-f742-4046-a7f2-36b19dd81dc5 req-0f87a237-9d5e-403d-bdd4-61b76cb65cfb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044991 Sep 14 12:07:22.649514 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 123/232] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:07:22.813035 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a8d5372d-a03f-41d0-b33a-ba1fa7ac67e6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:22.813833 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a8d5372d-a03f-41d0-b33a-ba1fa7ac67e6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:22.820716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8d5372d-a03f-41d0-b33a-ba1fa7ac67e6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:22.821561 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8d5372d-a03f-41d0-b33a-ba1fa7ac67e6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:22.822238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8d5372d-a03f-41d0-b33a-ba1fa7ac67e6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:22.823161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8d5372d-a03f-41d0-b33a-ba1fa7ac67e6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:22.823796 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8d5372d-a03f-41d0-b33a-ba1fa7ac67e6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:22.824557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8d5372d-a03f-41d0-b33a-ba1fa7ac67e6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:22.983839 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a8d5372d-a03f-41d0-b33a-ba1fa7ac67e6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:22.994427 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a8d5372d-a03f-41d0-b33a-ba1fa7ac67e6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.185650 Sep 14 12:07:22.996095 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 124/233] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:22 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:23.025541 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-225871d7-9392-4dc5-9909-4286d9c0b2ce tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:23.026370 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-225871d7-9392-4dc5-9909-4286d9c0b2ce tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:23.038310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-225871d7-9392-4dc5-9909-4286d9c0b2ce tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:23.039027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-225871d7-9392-4dc5-9909-4286d9c0b2ce tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:23.039538 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-225871d7-9392-4dc5-9909-4286d9c0b2ce tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:23.040318 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-225871d7-9392-4dc5-9909-4286d9c0b2ce tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:23.041081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-225871d7-9392-4dc5-9909-4286d9c0b2ce tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:23.041953 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-225871d7-9392-4dc5-9909-4286d9c0b2ce tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:23.231681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-225871d7-9392-4dc5-9909-4286d9c0b2ce tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:23.241771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-225871d7-9392-4dc5-9909-4286d9c0b2ce tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.222121 Sep 14 12:07:23.254689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 125/234] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:23 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:24.026941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6d69a872-ccef-4968-b854-dd3f221d6657 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:24.028750 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6d69a872-ccef-4968-b854-dd3f221d6657 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:24.035731 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6d69a872-ccef-4968-b854-dd3f221d6657 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:24.036217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6d69a872-ccef-4968-b854-dd3f221d6657 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:24.036653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6d69a872-ccef-4968-b854-dd3f221d6657 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:24.037359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6d69a872-ccef-4968-b854-dd3f221d6657 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:24.037811 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6d69a872-ccef-4968-b854-dd3f221d6657 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:24.038266 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6d69a872-ccef-4968-b854-dd3f221d6657 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:24.306164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6d69a872-ccef-4968-b854-dd3f221d6657 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:24.319230 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6d69a872-ccef-4968-b854-dd3f221d6657 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.298972 Sep 14 12:07:24.341912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 126/235] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:24 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:24.341912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fde03bfb-e3a6-4cb2-932b-2ea76e2f891b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:24.341912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-fde03bfb-e3a6-4cb2-932b-2ea76e2f891b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:24.354045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fde03bfb-e3a6-4cb2-932b-2ea76e2f891b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:24.354630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fde03bfb-e3a6-4cb2-932b-2ea76e2f891b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:24.355090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fde03bfb-e3a6-4cb2-932b-2ea76e2f891b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:24.358192 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fde03bfb-e3a6-4cb2-932b-2ea76e2f891b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:24.358700 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fde03bfb-e3a6-4cb2-932b-2ea76e2f891b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:24.359655 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fde03bfb-e3a6-4cb2-932b-2ea76e2f891b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:24.578952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fde03bfb-e3a6-4cb2-932b-2ea76e2f891b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:24.598401 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-fde03bfb-e3a6-4cb2-932b-2ea76e2f891b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.268111 Sep 14 12:07:24.616087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 127/236] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:24 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:25.359233 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3471643b-0ffa-4c66-87e9-eeb02359e7ad tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:25.361195 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3471643b-0ffa-4c66-87e9-eeb02359e7ad tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:25.375650 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3471643b-0ffa-4c66-87e9-eeb02359e7ad tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:25.381139 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3471643b-0ffa-4c66-87e9-eeb02359e7ad tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:25.381821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3471643b-0ffa-4c66-87e9-eeb02359e7ad tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:25.382812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3471643b-0ffa-4c66-87e9-eeb02359e7ad tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:25.383458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3471643b-0ffa-4c66-87e9-eeb02359e7ad tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:25.384189 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3471643b-0ffa-4c66-87e9-eeb02359e7ad tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:25.769145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3471643b-0ffa-4c66-87e9-eeb02359e7ad tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:25.778207 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3471643b-0ffa-4c66-87e9-eeb02359e7ad tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.423315 Sep 14 12:07:25.785064 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 128/237] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:25 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:25.796061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2e50d20c-12b1-4623-8aa2-acee58786a10 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:25.805698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2e50d20c-12b1-4623-8aa2-acee58786a10 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:25.823587 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2e50d20c-12b1-4623-8aa2-acee58786a10 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:25.828425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2e50d20c-12b1-4623-8aa2-acee58786a10 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:25.828425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2e50d20c-12b1-4623-8aa2-acee58786a10 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:25.828425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2e50d20c-12b1-4623-8aa2-acee58786a10 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:25.828425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2e50d20c-12b1-4623-8aa2-acee58786a10 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:25.828921 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2e50d20c-12b1-4623-8aa2-acee58786a10 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:26.063290 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2e50d20c-12b1-4623-8aa2-acee58786a10 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:26.073741 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2e50d20c-12b1-4623-8aa2-acee58786a10 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.287241 Sep 14 12:07:26.089301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 129/238] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:25 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:26.510018 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-256c78ed-5bd9-4d2b-82ea-422e0e363749 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "POST /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.219426 Sep 14 12:07:26.516716 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 110/239] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:07:21 2022] POST /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba/os-volume_attachments => generated 194 bytes in 5221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:07:26.809307 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-07a8818c-32f8-4305-ba30-08a5f622d9bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:26.810560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-07a8818c-32f8-4305-ba30-08a5f622d9bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:26.817077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07a8818c-32f8-4305-ba30-08a5f622d9bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:26.817567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07a8818c-32f8-4305-ba30-08a5f622d9bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:26.818045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07a8818c-32f8-4305-ba30-08a5f622d9bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:26.823918 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07a8818c-32f8-4305-ba30-08a5f622d9bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:26.823918 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07a8818c-32f8-4305-ba30-08a5f622d9bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:26.823918 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07a8818c-32f8-4305-ba30-08a5f622d9bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:26.976010 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-07a8818c-32f8-4305-ba30-08a5f622d9bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:27.006438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-07a8818c-32f8-4305-ba30-08a5f622d9bb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.183252 Sep 14 12:07:27.006438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 130/240] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:26 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:27.108732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b12951d3-61c9-4d18-9f08-6abbdadb3f7b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:27.108732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b12951d3-61c9-4d18-9f08-6abbdadb3f7b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:27.108732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=82 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:27.116591 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b12951d3-61c9-4d18-9f08-6abbdadb3f7b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:27.117107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b12951d3-61c9-4d18-9f08-6abbdadb3f7b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:27.117547 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b12951d3-61c9-4d18-9f08-6abbdadb3f7b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:27.118307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b12951d3-61c9-4d18-9f08-6abbdadb3f7b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:27.119070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b12951d3-61c9-4d18-9f08-6abbdadb3f7b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:27.119641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b12951d3-61c9-4d18-9f08-6abbdadb3f7b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:27.344518 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b12951d3-61c9-4d18-9f08-6abbdadb3f7b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:27.355987 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b12951d3-61c9-4d18-9f08-6abbdadb3f7b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.260412 Sep 14 12:07:27.356852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 111/241] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:27 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:28.021037 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-19301364-4b72-45f8-a617-274b6a2c9277 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:28.021639 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-19301364-4b72-45f8-a617-274b6a2c9277 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:28.047552 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19301364-4b72-45f8-a617-274b6a2c9277 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:28.048065 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19301364-4b72-45f8-a617-274b6a2c9277 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:28.048488 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19301364-4b72-45f8-a617-274b6a2c9277 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:28.049193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19301364-4b72-45f8-a617-274b6a2c9277 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:28.049639 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19301364-4b72-45f8-a617-274b6a2c9277 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:28.050798 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19301364-4b72-45f8-a617-274b6a2c9277 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:28.216503 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-19301364-4b72-45f8-a617-274b6a2c9277 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:28.225412 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-19301364-4b72-45f8-a617-274b6a2c9277 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.209428 Sep 14 12:07:28.226604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 131/242] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:28 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:28.380253 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5af4c9a1-4448-4f5e-aac6-cc351a097470 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:28.380905 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5af4c9a1-4448-4f5e-aac6-cc351a097470 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:28.388336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5af4c9a1-4448-4f5e-aac6-cc351a097470 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:28.388833 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5af4c9a1-4448-4f5e-aac6-cc351a097470 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:28.389294 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5af4c9a1-4448-4f5e-aac6-cc351a097470 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:28.390010 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5af4c9a1-4448-4f5e-aac6-cc351a097470 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:28.391046 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5af4c9a1-4448-4f5e-aac6-cc351a097470 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:28.391474 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5af4c9a1-4448-4f5e-aac6-cc351a097470 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:28.553485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5af4c9a1-4448-4f5e-aac6-cc351a097470 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:28.563635 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5af4c9a1-4448-4f5e-aac6-cc351a097470 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.187224 Sep 14 12:07:28.564944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 112/243] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:28 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:29.250195 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-32522fc3-edb5-47f1-b5db-036821ff1776 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:29.251074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-32522fc3-edb5-47f1-b5db-036821ff1776 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:29.257471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32522fc3-edb5-47f1-b5db-036821ff1776 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:29.258074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32522fc3-edb5-47f1-b5db-036821ff1776 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:29.258671 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32522fc3-edb5-47f1-b5db-036821ff1776 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:29.259409 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32522fc3-edb5-47f1-b5db-036821ff1776 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:29.259954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32522fc3-edb5-47f1-b5db-036821ff1776 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:29.260385 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-32522fc3-edb5-47f1-b5db-036821ff1776 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:29.587611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8a88604d-381b-4659-8b8a-e9cb45fa85a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:29.588350 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8a88604d-381b-4659-8b8a-e9cb45fa85a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:29.595887 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a88604d-381b-4659-8b8a-e9cb45fa85a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:29.596377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a88604d-381b-4659-8b8a-e9cb45fa85a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:29.596813 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a88604d-381b-4659-8b8a-e9cb45fa85a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:29.602154 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a88604d-381b-4659-8b8a-e9cb45fa85a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:29.603372 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a88604d-381b-4659-8b8a-e9cb45fa85a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:29.604503 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a88604d-381b-4659-8b8a-e9cb45fa85a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:29.633402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-32522fc3-edb5-47f1-b5db-036821ff1776 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:29.640163 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:29.643704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-32522fc3-edb5-47f1-b5db-036821ff1776 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.398316 Sep 14 12:07:29.644279 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 132/244] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:29 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:29.767063 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8a88604d-381b-4659-8b8a-e9cb45fa85a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:29.779517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8a88604d-381b-4659-8b8a-e9cb45fa85a3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.196305 Sep 14 12:07:29.780252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 113/245] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:29 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:30.670828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5903b305-8636-4815-b049-21a113412fc8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:30.672953 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5903b305-8636-4815-b049-21a113412fc8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:30.685323 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5903b305-8636-4815-b049-21a113412fc8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:30.685323 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5903b305-8636-4815-b049-21a113412fc8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:30.686156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5903b305-8636-4815-b049-21a113412fc8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:30.686990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5903b305-8636-4815-b049-21a113412fc8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:30.687450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5903b305-8636-4815-b049-21a113412fc8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:30.687899 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5903b305-8636-4815-b049-21a113412fc8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:30.807044 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-15ed0339-01bc-4b51-9a80-66baa6e9d32e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:30.808894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-15ed0339-01bc-4b51-9a80-66baa6e9d32e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:30.817949 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15ed0339-01bc-4b51-9a80-66baa6e9d32e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:30.818667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15ed0339-01bc-4b51-9a80-66baa6e9d32e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:30.820047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15ed0339-01bc-4b51-9a80-66baa6e9d32e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:30.820778 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15ed0339-01bc-4b51-9a80-66baa6e9d32e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:30.821240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15ed0339-01bc-4b51-9a80-66baa6e9d32e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:30.821826 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-15ed0339-01bc-4b51-9a80-66baa6e9d32e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:30.834217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5903b305-8636-4815-b049-21a113412fc8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:30.854229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5903b305-8636-4815-b049-21a113412fc8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.185999 Sep 14 12:07:30.854229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 133/246] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:30 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:30.971085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-15ed0339-01bc-4b51-9a80-66baa6e9d32e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:30.982661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-15ed0339-01bc-4b51-9a80-66baa6e9d32e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.180619 Sep 14 12:07:30.988478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 114/247] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:30 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:31.877656 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b67eec61-811e-454c-b3c0-6477190b55ae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:31.878357 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b67eec61-811e-454c-b3c0-6477190b55ae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:31.880870 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=85 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:31.891524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b67eec61-811e-454c-b3c0-6477190b55ae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:31.891977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b67eec61-811e-454c-b3c0-6477190b55ae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:31.897088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b67eec61-811e-454c-b3c0-6477190b55ae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:31.898102 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b67eec61-811e-454c-b3c0-6477190b55ae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:31.900035 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b67eec61-811e-454c-b3c0-6477190b55ae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:31.903064 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b67eec61-811e-454c-b3c0-6477190b55ae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:32.014933 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e30b9aae-ae28-4373-86e4-66700ad32171 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:32.016351 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e30b9aae-ae28-4373-86e4-66700ad32171 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:32.029390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e30b9aae-ae28-4373-86e4-66700ad32171 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:32.030441 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e30b9aae-ae28-4373-86e4-66700ad32171 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:32.031772 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e30b9aae-ae28-4373-86e4-66700ad32171 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:32.032695 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e30b9aae-ae28-4373-86e4-66700ad32171 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:32.033350 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e30b9aae-ae28-4373-86e4-66700ad32171 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:32.034036 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e30b9aae-ae28-4373-86e4-66700ad32171 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:32.185211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b67eec61-811e-454c-b3c0-6477190b55ae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:32.195959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b67eec61-811e-454c-b3c0-6477190b55ae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.322548 Sep 14 12:07:32.197973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 134/248] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:31 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:32.279440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e30b9aae-ae28-4373-86e4-66700ad32171 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:32.287257 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e30b9aae-ae28-4373-86e4-66700ad32171 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1321 microversion: 2.1 time: 0.279310 Sep 14 12:07:32.287846 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 115/249] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:32 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:32.680945 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-b8e28f43-971a-40f1-a370-0c39b2962dde req-26418111-1364-4af8-aac3-f7c4f029e38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ce41d2-7079-429c-a18a-de51b2c20e6b", "name": "network-vif-plugged", "status": "completed", "tag": "07ecea17-6958-4771-b1ae-f0ad902c21eb"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:32.688111 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b8e28f43-971a-40f1-a370-0c39b2962dde req-26418111-1364-4af8-aac3-f7c4f029e38a service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:32.688588 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b8e28f43-971a-40f1-a370-0c39b2962dde req-26418111-1364-4af8-aac3-f7c4f029e38a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:32.689088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b8e28f43-971a-40f1-a370-0c39b2962dde req-26418111-1364-4af8-aac3-f7c4f029e38a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:32.700747 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-b8e28f43-971a-40f1-a370-0c39b2962dde req-26418111-1364-4af8-aac3-f7c4f029e38a service nova] Creating event network-vif-plugged:07ecea17-6958-4771-b1ae-f0ad902c21eb for instance 76ce41d2-7079-429c-a18a-de51b2c20e6b on hv-cinder-84496 Sep 14 12:07:32.709190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-b8e28f43-971a-40f1-a370-0c39b2962dde req-26418111-1364-4af8-aac3-f7c4f029e38a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038907 Sep 14 12:07:32.712584 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 135/250] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:07:33.223277 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-26a54eea-d839-4898-858e-6ab388b00078 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:33.225645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-26a54eea-d839-4898-858e-6ab388b00078 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:33.236012 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26a54eea-d839-4898-858e-6ab388b00078 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:33.236743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26a54eea-d839-4898-858e-6ab388b00078 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:33.237561 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26a54eea-d839-4898-858e-6ab388b00078 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:33.239177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26a54eea-d839-4898-858e-6ab388b00078 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:33.240502 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26a54eea-d839-4898-858e-6ab388b00078 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:33.240920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26a54eea-d839-4898-858e-6ab388b00078 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:33.314290 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3837267e-2339-470e-a322-865e572e1959 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:33.315026 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3837267e-2339-470e-a322-865e572e1959 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:33.322128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3837267e-2339-470e-a322-865e572e1959 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:33.322654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3837267e-2339-470e-a322-865e572e1959 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:33.323088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3837267e-2339-470e-a322-865e572e1959 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:33.323785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3837267e-2339-470e-a322-865e572e1959 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:33.324259 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3837267e-2339-470e-a322-865e572e1959 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:33.324676 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3837267e-2339-470e-a322-865e572e1959 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:33.428852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-26a54eea-d839-4898-858e-6ab388b00078 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:33.439477 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-26a54eea-d839-4898-858e-6ab388b00078 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.222494 Sep 14 12:07:33.440576 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 116/251] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:33 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:33.506160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3837267e-2339-470e-a322-865e572e1959 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:33.520193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3837267e-2339-470e-a322-865e572e1959 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1515 microversion: 2.1 time: 0.210109 Sep 14 12:07:33.533451 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 136/252] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:33 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:33.545794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8b276262-e47e-47b9-82f0-01018d37104d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:33.548410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8b276262-e47e-47b9-82f0-01018d37104d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:33.554796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b276262-e47e-47b9-82f0-01018d37104d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:33.557282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b276262-e47e-47b9-82f0-01018d37104d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:33.557282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b276262-e47e-47b9-82f0-01018d37104d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:33.557282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b276262-e47e-47b9-82f0-01018d37104d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:33.557893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b276262-e47e-47b9-82f0-01018d37104d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:33.558498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8b276262-e47e-47b9-82f0-01018d37104d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:33.594205 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-8b276262-e47e-47b9-82f0-01018d37104d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lazy-loading 'flavor' on Instance uuid 3f808ebd-698e-480a-9eac-4ef62bcc2b7b {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:07:33.978886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8b276262-e47e-47b9-82f0-01018d37104d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b/action" status: 200 len: 32 microversion: 2.1 time: 0.431025 Sep 14 12:07:33.978886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 117/253] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:07:33 2022] POST /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b/action => generated 32 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 12:07:33.985012 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-db1a4d2d-2273-4788-a7dc-a30eb3c8e0c3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:33.986065 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-db1a4d2d-2273-4788-a7dc-a30eb3c8e0c3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:33.992964 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db1a4d2d-2273-4788-a7dc-a30eb3c8e0c3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:33.994008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db1a4d2d-2273-4788-a7dc-a30eb3c8e0c3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:33.994438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db1a4d2d-2273-4788-a7dc-a30eb3c8e0c3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:33.995305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db1a4d2d-2273-4788-a7dc-a30eb3c8e0c3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:33.996497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db1a4d2d-2273-4788-a7dc-a30eb3c8e0c3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:33.997726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db1a4d2d-2273-4788-a7dc-a30eb3c8e0c3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:34.204685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-db1a4d2d-2273-4788-a7dc-a30eb3c8e0c3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:34.212784 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-db1a4d2d-2273-4788-a7dc-a30eb3c8e0c3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.232282 Sep 14 12:07:34.213360 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 137/254] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:33 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:34.464687 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a5290e23-d55d-4ec1-be9a-19f645862b20 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:34.465387 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a5290e23-d55d-4ec1-be9a-19f645862b20 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:34.472058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5290e23-d55d-4ec1-be9a-19f645862b20 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:34.472537 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5290e23-d55d-4ec1-be9a-19f645862b20 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:34.472968 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5290e23-d55d-4ec1-be9a-19f645862b20 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:34.473656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5290e23-d55d-4ec1-be9a-19f645862b20 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:34.474140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5290e23-d55d-4ec1-be9a-19f645862b20 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:34.474557 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5290e23-d55d-4ec1-be9a-19f645862b20 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:34.695048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a5290e23-d55d-4ec1-be9a-19f645862b20 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:34.703501 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a5290e23-d55d-4ec1-be9a-19f645862b20 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.242813 Sep 14 12:07:34.703870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 118/255] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:34 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:35.236113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-56c8e61e-1e9f-4da4-9095-0c2066f7ab31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:35.237660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-56c8e61e-1e9f-4da4-9095-0c2066f7ab31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:35.244091 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56c8e61e-1e9f-4da4-9095-0c2066f7ab31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:35.244890 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56c8e61e-1e9f-4da4-9095-0c2066f7ab31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:35.245520 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56c8e61e-1e9f-4da4-9095-0c2066f7ab31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:35.246440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56c8e61e-1e9f-4da4-9095-0c2066f7ab31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:35.246895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56c8e61e-1e9f-4da4-9095-0c2066f7ab31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:35.251635 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56c8e61e-1e9f-4da4-9095-0c2066f7ab31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:35.496578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-56c8e61e-1e9f-4da4-9095-0c2066f7ab31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:35.506200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-56c8e61e-1e9f-4da4-9095-0c2066f7ab31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.273844 Sep 14 12:07:35.507145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 138/256] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:35 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:35.726400 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2f215fd0-5808-4e5c-80c3-5b9a13f9bd53 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:35.727081 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2f215fd0-5808-4e5c-80c3-5b9a13f9bd53 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:35.733674 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f215fd0-5808-4e5c-80c3-5b9a13f9bd53 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:35.734315 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f215fd0-5808-4e5c-80c3-5b9a13f9bd53 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:35.734706 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f215fd0-5808-4e5c-80c3-5b9a13f9bd53 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:35.735413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f215fd0-5808-4e5c-80c3-5b9a13f9bd53 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:35.735860 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f215fd0-5808-4e5c-80c3-5b9a13f9bd53 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:35.736479 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f215fd0-5808-4e5c-80c3-5b9a13f9bd53 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:35.948835 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2f215fd0-5808-4e5c-80c3-5b9a13f9bd53 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:35.954457 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2f215fd0-5808-4e5c-80c3-5b9a13f9bd53 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1363 microversion: 2.1 time: 0.231814 Sep 14 12:07:35.955192 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 119/257] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:35 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:36.536574 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d7979917-a3b5-4ae3-813b-09e5ec3aed8d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:36.539327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d7979917-a3b5-4ae3-813b-09e5ec3aed8d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:36.544711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7979917-a3b5-4ae3-813b-09e5ec3aed8d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:36.545210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7979917-a3b5-4ae3-813b-09e5ec3aed8d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:36.545645 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7979917-a3b5-4ae3-813b-09e5ec3aed8d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:36.546382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7979917-a3b5-4ae3-813b-09e5ec3aed8d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:36.546833 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7979917-a3b5-4ae3-813b-09e5ec3aed8d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:36.547272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7979917-a3b5-4ae3-813b-09e5ec3aed8d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:36.741269 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d7979917-a3b5-4ae3-813b-09e5ec3aed8d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:36.743982 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d7979917-a3b5-4ae3-813b-09e5ec3aed8d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.211347 Sep 14 12:07:36.744774 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 139/258] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:36 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:36.977742 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-58d5aa29-32ad-46f9-a61a-8f4b64f8b90d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:36.978640 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-58d5aa29-32ad-46f9-a61a-8f4b64f8b90d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:36.986379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58d5aa29-32ad-46f9-a61a-8f4b64f8b90d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:36.987059 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58d5aa29-32ad-46f9-a61a-8f4b64f8b90d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:36.987574 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58d5aa29-32ad-46f9-a61a-8f4b64f8b90d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:36.988721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58d5aa29-32ad-46f9-a61a-8f4b64f8b90d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:36.989244 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58d5aa29-32ad-46f9-a61a-8f4b64f8b90d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:36.989786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58d5aa29-32ad-46f9-a61a-8f4b64f8b90d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:37.212169 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-58d5aa29-32ad-46f9-a61a-8f4b64f8b90d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:37.220641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-58d5aa29-32ad-46f9-a61a-8f4b64f8b90d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1550 microversion: 2.1 time: 0.247016 Sep 14 12:07:37.221242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 120/259] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:36 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1550 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:37.251048 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-653e0573-f2db-4134-bc5d-9ae373eaa619 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:37.251558 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-653e0573-f2db-4134-bc5d-9ae373eaa619 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:37.258328 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-653e0573-f2db-4134-bc5d-9ae373eaa619 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:37.258857 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-653e0573-f2db-4134-bc5d-9ae373eaa619 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:37.259293 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-653e0573-f2db-4134-bc5d-9ae373eaa619 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:37.260041 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-653e0573-f2db-4134-bc5d-9ae373eaa619 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:37.260497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-653e0573-f2db-4134-bc5d-9ae373eaa619 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:37.260950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-653e0573-f2db-4134-bc5d-9ae373eaa619 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:37.265343 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:37.347823 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-653e0573-f2db-4134-bc5d-9ae373eaa619 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102746 Sep 14 12:07:37.348445 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 140/260] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 14 12:07:37 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:07:37.771383 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-eaf94e13-a93b-46ee-ab6f-da3f06cecd81 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:37.773368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-eaf94e13-a93b-46ee-ab6f-da3f06cecd81 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:37.783461 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eaf94e13-a93b-46ee-ab6f-da3f06cecd81 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:37.784363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eaf94e13-a93b-46ee-ab6f-da3f06cecd81 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:37.784999 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eaf94e13-a93b-46ee-ab6f-da3f06cecd81 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:37.786731 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eaf94e13-a93b-46ee-ab6f-da3f06cecd81 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:37.787189 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eaf94e13-a93b-46ee-ab6f-da3f06cecd81 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:37.790149 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eaf94e13-a93b-46ee-ab6f-da3f06cecd81 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:38.035170 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-eaf94e13-a93b-46ee-ab6f-da3f06cecd81 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:38.042289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-eaf94e13-a93b-46ee-ab6f-da3f06cecd81 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.277436 Sep 14 12:07:38.042894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 121/261] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:37 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:38.908604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-c5d550de-5ef1-4301-854b-9fabedca1bf2 req-1ed31809-8b7e-42f7-b791-b6443f200ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ce41d2-7079-429c-a18a-de51b2c20e6b", "tag": "07ecea17-6958-4771-b1ae-f0ad902c21eb"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:38.908604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-c5d550de-5ef1-4301-854b-9fabedca1bf2 req-1ed31809-8b7e-42f7-b791-b6443f200ba0 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:38.908604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-c5d550de-5ef1-4301-854b-9fabedca1bf2 req-1ed31809-8b7e-42f7-b791-b6443f200ba0 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:38.908604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-c5d550de-5ef1-4301-854b-9fabedca1bf2 req-1ed31809-8b7e-42f7-b791-b6443f200ba0 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:38.929845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-c5d550de-5ef1-4301-854b-9fabedca1bf2 req-1ed31809-8b7e-42f7-b791-b6443f200ba0 service nova] Creating event network-changed:07ecea17-6958-4771-b1ae-f0ad902c21eb for instance 76ce41d2-7079-429c-a18a-de51b2c20e6b on hv-cinder-84496 Sep 14 12:07:38.940236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-c5d550de-5ef1-4301-854b-9fabedca1bf2 req-1ed31809-8b7e-42f7-b791-b6443f200ba0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056255 Sep 14 12:07:38.942205 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 141/262] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:07:39.065738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c3c41e3a-6621-40c9-a0ed-a1964808d282 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:39.066390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c3c41e3a-6621-40c9-a0ed-a1964808d282 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:39.072827 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c41e3a-6621-40c9-a0ed-a1964808d282 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:39.073389 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c41e3a-6621-40c9-a0ed-a1964808d282 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:39.073913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c41e3a-6621-40c9-a0ed-a1964808d282 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:39.074702 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c41e3a-6621-40c9-a0ed-a1964808d282 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:39.075202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c41e3a-6621-40c9-a0ed-a1964808d282 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:39.075752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c3c41e3a-6621-40c9-a0ed-a1964808d282 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:39.481153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c3c41e3a-6621-40c9-a0ed-a1964808d282 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:39.488909 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c3c41e3a-6621-40c9-a0ed-a1964808d282 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.427411 Sep 14 12:07:39.502296 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 122/263] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:39 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:40.514407 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1c482aac-4c99-4983-ab46-0006ab52111c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:40.518724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1c482aac-4c99-4983-ab46-0006ab52111c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:40.525479 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c482aac-4c99-4983-ab46-0006ab52111c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:40.526533 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c482aac-4c99-4983-ab46-0006ab52111c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:40.527162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c482aac-4c99-4983-ab46-0006ab52111c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:40.528189 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c482aac-4c99-4983-ab46-0006ab52111c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:40.529600 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c482aac-4c99-4983-ab46-0006ab52111c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:40.530289 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c482aac-4c99-4983-ab46-0006ab52111c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:40.758752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1c482aac-4c99-4983-ab46-0006ab52111c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:40.766731 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1c482aac-4c99-4983-ab46-0006ab52111c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.257244 Sep 14 12:07:40.767291 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 142/264] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:40 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:41.790844 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4aaf3124-6fa5-4375-9fbc-ad1818b1590a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:41.791313 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4aaf3124-6fa5-4375-9fbc-ad1818b1590a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:41.797810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4aaf3124-6fa5-4375-9fbc-ad1818b1590a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:41.798436 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4aaf3124-6fa5-4375-9fbc-ad1818b1590a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:41.799016 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4aaf3124-6fa5-4375-9fbc-ad1818b1590a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:41.800035 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4aaf3124-6fa5-4375-9fbc-ad1818b1590a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:41.800598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4aaf3124-6fa5-4375-9fbc-ad1818b1590a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:41.801133 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4aaf3124-6fa5-4375-9fbc-ad1818b1590a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:41.983744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4aaf3124-6fa5-4375-9fbc-ad1818b1590a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:41.991586 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4aaf3124-6fa5-4375-9fbc-ad1818b1590a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.205835 Sep 14 12:07:41.992228 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 123/265] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:41 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:43.016508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3b1fab2c-fe9b-4873-8fb3-5e2bd7cbe253 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:43.017843 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3b1fab2c-fe9b-4873-8fb3-5e2bd7cbe253 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:43.029272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b1fab2c-fe9b-4873-8fb3-5e2bd7cbe253 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:43.029272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b1fab2c-fe9b-4873-8fb3-5e2bd7cbe253 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:43.029272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b1fab2c-fe9b-4873-8fb3-5e2bd7cbe253 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:43.029272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b1fab2c-fe9b-4873-8fb3-5e2bd7cbe253 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:43.029707 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b1fab2c-fe9b-4873-8fb3-5e2bd7cbe253 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:43.029707 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b1fab2c-fe9b-4873-8fb3-5e2bd7cbe253 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:43.174756 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3b1fab2c-fe9b-4873-8fb3-5e2bd7cbe253 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:43.183462 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3b1fab2c-fe9b-4873-8fb3-5e2bd7cbe253 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.172448 Sep 14 12:07:43.184040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 143/266] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:43 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:44.205852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-04efa13e-cd21-48a9-bcad-570e202c05a2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:44.206504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-04efa13e-cd21-48a9-bcad-570e202c05a2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:44.214127 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04efa13e-cd21-48a9-bcad-570e202c05a2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:44.214616 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04efa13e-cd21-48a9-bcad-570e202c05a2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:44.215058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04efa13e-cd21-48a9-bcad-570e202c05a2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:44.215789 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04efa13e-cd21-48a9-bcad-570e202c05a2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:44.216239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04efa13e-cd21-48a9-bcad-570e202c05a2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:44.216666 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04efa13e-cd21-48a9-bcad-570e202c05a2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:44.360025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-04efa13e-cd21-48a9-bcad-570e202c05a2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:44.373268 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-04efa13e-cd21-48a9-bcad-570e202c05a2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.167623 Sep 14 12:07:44.373268 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 124/267] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:44 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:45.396288 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a516ce4e-fc2d-4e36-aa52-17af8b6a4d12 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:45.396937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a516ce4e-fc2d-4e36-aa52-17af8b6a4d12 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:45.404366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a516ce4e-fc2d-4e36-aa52-17af8b6a4d12 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:45.404867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a516ce4e-fc2d-4e36-aa52-17af8b6a4d12 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:45.406507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a516ce4e-fc2d-4e36-aa52-17af8b6a4d12 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:45.407233 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a516ce4e-fc2d-4e36-aa52-17af8b6a4d12 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:45.407698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a516ce4e-fc2d-4e36-aa52-17af8b6a4d12 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:45.408126 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a516ce4e-fc2d-4e36-aa52-17af8b6a4d12 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:45.586258 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a516ce4e-fc2d-4e36-aa52-17af8b6a4d12 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:45.596688 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a516ce4e-fc2d-4e36-aa52-17af8b6a4d12 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.205178 Sep 14 12:07:45.597373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 144/268] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:45 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:46.565372 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-97760105-db30-473d-a8bc-32c1a9a8a8c3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:46.566020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-97760105-db30-473d-a8bc-32c1a9a8a8c3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:46.572859 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97760105-db30-473d-a8bc-32c1a9a8a8c3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:46.573415 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97760105-db30-473d-a8bc-32c1a9a8a8c3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:46.573847 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97760105-db30-473d-a8bc-32c1a9a8a8c3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:46.575171 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97760105-db30-473d-a8bc-32c1a9a8a8c3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:46.575332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97760105-db30-473d-a8bc-32c1a9a8a8c3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:46.575754 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97760105-db30-473d-a8bc-32c1a9a8a8c3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:46.603559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-97760105-db30-473d-a8bc-32c1a9a8a8c3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:07:46.622236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-01fc4747-647d-46e4-995a-3aa0aeb6b634 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:46.622848 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-01fc4747-647d-46e4-995a-3aa0aeb6b634 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:46.629234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01fc4747-647d-46e4-995a-3aa0aeb6b634 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:46.629726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01fc4747-647d-46e4-995a-3aa0aeb6b634 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:46.630331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01fc4747-647d-46e4-995a-3aa0aeb6b634 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:46.631283 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01fc4747-647d-46e4-995a-3aa0aeb6b634 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:46.631828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01fc4747-647d-46e4-995a-3aa0aeb6b634 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:46.632474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01fc4747-647d-46e4-995a-3aa0aeb6b634 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:46.781205 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-01fc4747-647d-46e4-995a-3aa0aeb6b634 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:46.791201 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-01fc4747-647d-46e4-995a-3aa0aeb6b634 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.172965 Sep 14 12:07:46.791805 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 145/269] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:46 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:47.002431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-97760105-db30-473d-a8bc-32c1a9a8a8c3 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 204 len: 0 microversion: 2.1 time: 0.442497 Sep 14 12:07:47.003027 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 125/270] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:07:46 2022] DELETE /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:07:47.012209 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0f0be2f2-91b0-4318-be61-b95fa55cdb06 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:47.013128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0f0be2f2-91b0-4318-be61-b95fa55cdb06 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:47.019590 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0f0be2f2-91b0-4318-be61-b95fa55cdb06 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:47.020072 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0f0be2f2-91b0-4318-be61-b95fa55cdb06 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:47.020768 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0f0be2f2-91b0-4318-be61-b95fa55cdb06 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:47.021642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0f0be2f2-91b0-4318-be61-b95fa55cdb06 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:47.021992 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0f0be2f2-91b0-4318-be61-b95fa55cdb06 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:47.022406 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0f0be2f2-91b0-4318-be61-b95fa55cdb06 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:47.170959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0f0be2f2-91b0-4318-be61-b95fa55cdb06 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:47.179358 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0f0be2f2-91b0-4318-be61-b95fa55cdb06 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1553 microversion: 2.1 time: 0.171466 Sep 14 12:07:47.180154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 146/271] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:47 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:47.816107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d418b0a2-fc40-44c0-82e6-95d2dc28b7df tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:47.817516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d418b0a2-fc40-44c0-82e6-95d2dc28b7df tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:47.824993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d418b0a2-fc40-44c0-82e6-95d2dc28b7df tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:47.825886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d418b0a2-fc40-44c0-82e6-95d2dc28b7df tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:47.826806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d418b0a2-fc40-44c0-82e6-95d2dc28b7df tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:47.829118 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d418b0a2-fc40-44c0-82e6-95d2dc28b7df tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:47.829796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d418b0a2-fc40-44c0-82e6-95d2dc28b7df tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:47.830640 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d418b0a2-fc40-44c0-82e6-95d2dc28b7df tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:47.857533 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:48.000437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d418b0a2-fc40-44c0-82e6-95d2dc28b7df tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:48.017032 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d418b0a2-fc40-44c0-82e6-95d2dc28b7df tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.205107 Sep 14 12:07:48.018364 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 126/272] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:47 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:48.204242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e5205a68-62f8-4f2d-bbef-fdc6c7d1e572 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:48.204770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e5205a68-62f8-4f2d-bbef-fdc6c7d1e572 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:48.211027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e5205a68-62f8-4f2d-bbef-fdc6c7d1e572 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:48.211472 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e5205a68-62f8-4f2d-bbef-fdc6c7d1e572 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:48.211901 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e5205a68-62f8-4f2d-bbef-fdc6c7d1e572 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:48.212597 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e5205a68-62f8-4f2d-bbef-fdc6c7d1e572 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:48.213036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e5205a68-62f8-4f2d-bbef-fdc6c7d1e572 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:48.213453 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e5205a68-62f8-4f2d-bbef-fdc6c7d1e572 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:48.357450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e5205a68-62f8-4f2d-bbef-fdc6c7d1e572 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:48.367084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e5205a68-62f8-4f2d-bbef-fdc6c7d1e572 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1553 microversion: 2.1 time: 0.166377 Sep 14 12:07:48.367836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 147/273] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:48 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:49.041076 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4d7bf38b-5995-462a-9373-6e0219639058 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:49.047825 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4d7bf38b-5995-462a-9373-6e0219639058 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:49.052085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d7bf38b-5995-462a-9373-6e0219639058 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:49.052829 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d7bf38b-5995-462a-9373-6e0219639058 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:49.053903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d7bf38b-5995-462a-9373-6e0219639058 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:49.055410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d7bf38b-5995-462a-9373-6e0219639058 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:49.056384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d7bf38b-5995-462a-9373-6e0219639058 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:49.057177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d7bf38b-5995-462a-9373-6e0219639058 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:49.206890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4d7bf38b-5995-462a-9373-6e0219639058 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:49.212699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4d7bf38b-5995-462a-9373-6e0219639058 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.175992 Sep 14 12:07:49.213305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 127/274] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:49 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:49.391002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8fb9aad6-2000-4d2e-b52a-84147185515d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:49.391605 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8fb9aad6-2000-4d2e-b52a-84147185515d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:49.397916 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fb9aad6-2000-4d2e-b52a-84147185515d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:49.398406 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fb9aad6-2000-4d2e-b52a-84147185515d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:49.399121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fb9aad6-2000-4d2e-b52a-84147185515d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:49.399858 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fb9aad6-2000-4d2e-b52a-84147185515d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:49.400322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fb9aad6-2000-4d2e-b52a-84147185515d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:49.400711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fb9aad6-2000-4d2e-b52a-84147185515d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:49.551965 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8fb9aad6-2000-4d2e-b52a-84147185515d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:49.566010 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8fb9aad6-2000-4d2e-b52a-84147185515d tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1553 microversion: 2.1 time: 0.179722 Sep 14 12:07:49.566727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 148/275] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:49 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:50.236363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b635d8fc-6d88-4463-8de7-1e64f72d683a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:50.237461 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b635d8fc-6d88-4463-8de7-1e64f72d683a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:50.244989 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b635d8fc-6d88-4463-8de7-1e64f72d683a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:50.245485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b635d8fc-6d88-4463-8de7-1e64f72d683a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:50.245948 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b635d8fc-6d88-4463-8de7-1e64f72d683a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:50.246960 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b635d8fc-6d88-4463-8de7-1e64f72d683a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:50.247105 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b635d8fc-6d88-4463-8de7-1e64f72d683a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:50.248226 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b635d8fc-6d88-4463-8de7-1e64f72d683a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:50.401932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b635d8fc-6d88-4463-8de7-1e64f72d683a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:50.406328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b635d8fc-6d88-4463-8de7-1e64f72d683a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.174614 Sep 14 12:07:50.406922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 128/276] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:50 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:50.591340 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-022266bb-73c9-4e4f-abb8-54c37ccb7d96 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:50.591968 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-022266bb-73c9-4e4f-abb8-54c37ccb7d96 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:50.598071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-022266bb-73c9-4e4f-abb8-54c37ccb7d96 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:50.598592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-022266bb-73c9-4e4f-abb8-54c37ccb7d96 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:50.598983 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-022266bb-73c9-4e4f-abb8-54c37ccb7d96 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:50.599938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-022266bb-73c9-4e4f-abb8-54c37ccb7d96 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:50.600398 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-022266bb-73c9-4e4f-abb8-54c37ccb7d96 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:50.601011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-022266bb-73c9-4e4f-abb8-54c37ccb7d96 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:50.786705 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-022266bb-73c9-4e4f-abb8-54c37ccb7d96 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:50.795113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-022266bb-73c9-4e4f-abb8-54c37ccb7d96 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1553 microversion: 2.1 time: 0.207708 Sep 14 12:07:50.795725 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 149/277] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:50 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:51.431271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1ac1bd69-1e46-4d87-9ad8-ec9e09dd626b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:51.432053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1ac1bd69-1e46-4d87-9ad8-ec9e09dd626b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:51.440427 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ac1bd69-1e46-4d87-9ad8-ec9e09dd626b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:51.440847 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ac1bd69-1e46-4d87-9ad8-ec9e09dd626b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:51.441478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ac1bd69-1e46-4d87-9ad8-ec9e09dd626b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:51.442239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ac1bd69-1e46-4d87-9ad8-ec9e09dd626b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:51.446388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ac1bd69-1e46-4d87-9ad8-ec9e09dd626b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:51.446388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ac1bd69-1e46-4d87-9ad8-ec9e09dd626b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:51.687598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1ac1bd69-1e46-4d87-9ad8-ec9e09dd626b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:51.699029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1ac1bd69-1e46-4d87-9ad8-ec9e09dd626b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.272872 Sep 14 12:07:51.701673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 129/278] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:51 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:51.736218 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-8a14141e-c4eb-4a61-a74a-7df1dd0177e8 req-0e8568c3-2e97-47b3-bce0-e22cfbf4b3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5195b11-b310-408b-a3d8-75d39abd9bba", "name": "network-vif-deleted", "tag": "8886c0e9-3f34-4a35-b75b-b420c97f524e"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:07:51.747099 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-8a14141e-c4eb-4a61-a74a-7df1dd0177e8 req-0e8568c3-2e97-47b3-bce0-e22cfbf4b3d2 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:51.747817 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-8a14141e-c4eb-4a61-a74a-7df1dd0177e8 req-0e8568c3-2e97-47b3-bce0-e22cfbf4b3d2 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:51.748391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-8a14141e-c4eb-4a61-a74a-7df1dd0177e8 req-0e8568c3-2e97-47b3-bce0-e22cfbf4b3d2 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:51.762798 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-8a14141e-c4eb-4a61-a74a-7df1dd0177e8 req-0e8568c3-2e97-47b3-bce0-e22cfbf4b3d2 service nova] Creating event network-vif-deleted:8886c0e9-3f34-4a35-b75b-b420c97f524e for instance a5195b11-b310-408b-a3d8-75d39abd9bba on hv-cinder-84496 Sep 14 12:07:51.768926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-8a14141e-c4eb-4a61-a74a-7df1dd0177e8 req-0e8568c3-2e97-47b3-bce0-e22cfbf4b3d2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036958 Sep 14 12:07:51.770458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 150/279] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:07:51.820216 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6fc8057a-79e0-4269-8eb9-17e4be0d0b66 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:51.823509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6fc8057a-79e0-4269-8eb9-17e4be0d0b66 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:51.834021 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc8057a-79e0-4269-8eb9-17e4be0d0b66 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:51.834564 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc8057a-79e0-4269-8eb9-17e4be0d0b66 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:51.835015 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc8057a-79e0-4269-8eb9-17e4be0d0b66 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:51.835854 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc8057a-79e0-4269-8eb9-17e4be0d0b66 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:51.836324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc8057a-79e0-4269-8eb9-17e4be0d0b66 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:51.836963 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc8057a-79e0-4269-8eb9-17e4be0d0b66 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:52.064313 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6fc8057a-79e0-4269-8eb9-17e4be0d0b66 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:52.074694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6fc8057a-79e0-4269-8eb9-17e4be0d0b66 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1511 microversion: 2.1 time: 0.258879 Sep 14 12:07:52.075787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 130/280] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:51 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:52.724190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1b2ca83f-817e-4996-8469-3b5409f26701 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:52.725441 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1b2ca83f-817e-4996-8469-3b5409f26701 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:52.742398 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b2ca83f-817e-4996-8469-3b5409f26701 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:52.743391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b2ca83f-817e-4996-8469-3b5409f26701 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:52.743391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b2ca83f-817e-4996-8469-3b5409f26701 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:52.744034 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b2ca83f-817e-4996-8469-3b5409f26701 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:52.744492 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b2ca83f-817e-4996-8469-3b5409f26701 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:52.744925 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1b2ca83f-817e-4996-8469-3b5409f26701 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:52.927660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1b2ca83f-817e-4996-8469-3b5409f26701 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:52.939105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1b2ca83f-817e-4996-8469-3b5409f26701 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.219566 Sep 14 12:07:52.939825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 151/281] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:52 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:07:53.116600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:53.118977 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:53.127929 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:53.128474 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:53.129015 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:53.129681 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:53.130177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:53.130809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:53.184974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:53.186117 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:53.187427 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:53.187997 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lazy-loading 'fault' on Instance uuid a5195b11-b310-408b-a3d8-75d39abd9bba {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:07:53.236264 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6b6321705947b6a395f77c11b1c6a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef2ab34a441b982b69839434d689e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:53.244825 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-39a771cf-f2ac-4d57-92e2-414f66855e36 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 200 len: 1350 microversion: 2.1 time: 0.134030 Sep 14 12:07:53.245673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 131/282] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:53 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:53.964360 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-745e103f-44b1-4a2f-8459-7e0137fc7555 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:53.965501 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-745e103f-44b1-4a2f-8459-7e0137fc7555 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:53.974728 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745e103f-44b1-4a2f-8459-7e0137fc7555 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:53.975236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745e103f-44b1-4a2f-8459-7e0137fc7555 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:53.975699 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745e103f-44b1-4a2f-8459-7e0137fc7555 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:53.976422 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745e103f-44b1-4a2f-8459-7e0137fc7555 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:53.977623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745e103f-44b1-4a2f-8459-7e0137fc7555 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:53.978236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745e103f-44b1-4a2f-8459-7e0137fc7555 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:54.143770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-745e103f-44b1-4a2f-8459-7e0137fc7555 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:54.152639 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-745e103f-44b1-4a2f-8459-7e0137fc7555 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.192628 Sep 14 12:07:54.168391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 152/283] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:53 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:54.270581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:54.271840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:54.279147 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:54.279650 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:54.280146 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:54.281341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:54.281799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:54.282254 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:54.297872 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] HTTP exception thrown: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Request method failure captured: Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba HTTP/1.1 Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcOzjJbsx6UeE4NVDA_2TH_K35YypVZx4KRJ5rqHE-9vKCgiKFyVZt2DzQ7U0IXXEev-Jwgg78NgEtqqo1cXKa9-warjHXASNG4YFxqtEnU8FzqipWo8fZx8FmXE9WdxBgALhi-U5Q1pHr3e0y-sO5Epm2Rdoc6W244DAOchmsr7C98 Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 933ef2ab34a441b982b69839434d689e Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:07:54.302923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/933ef2ab34a441b982b69839434d689e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/933ef2ab34a441b982b69839434d689e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_933ef2ab34a441b982b69839434d689e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/933ef2ab34a441b982b69839434d689e"}]}] Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 933ef2ab34a441b982b69839434d689e Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-DeleteServersTestJSON-1906471331-project Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 5d6b6321705947b6a395f77c11b1c6a5 Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-DeleteServersTestJSON-1906471331-project Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:54.304407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': 'a5195b11-b310-408b-a3d8-75d39abd9bba'} Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:07:54.305101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:54.306798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:07:54.308140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Returning 404 to user: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:07:54.308140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-52f367b1-1cc4-46e9-9a5e-f303810b7c55 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 404 len: 111 microversion: 2.1 time: 0.037690 Sep 14 12:07:54.308140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 132/284] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:54 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:07:54.439225 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:54.441553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:54.448171 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:54.448670 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:54.449109 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:54.453826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:54.453826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:54.453826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:54.467990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] HTTP exception thrown: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Request method failure captured: Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba/os-volume_attachments HTTP/1.1 Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOzjJbsx6UeE4NVDA_2TH_K35YypVZx4KRJ5rqHE-9vKCgiKFyVZt2DzQ7U0IXXEev-Jwgg78NgEtqqo1cXKa9-warjHXASNG4YFxqtEnU8FzqipWo8fZx8FmXE9WdxBgALhi-U5Q1pHr3e0y-sO5Epm2Rdoc6W244DAOchmsr7C98 Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 933ef2ab34a441b982b69839434d689e Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:07:54.472759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/933ef2ab34a441b982b69839434d689e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/933ef2ab34a441b982b69839434d689e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_933ef2ab34a441b982b69839434d689e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/933ef2ab34a441b982b69839434d689e"}]}] Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 933ef2ab34a441b982b69839434d689e Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-DeleteServersTestJSON-1906471331-project Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 5d6b6321705947b6a395f77c11b1c6a5 Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-DeleteServersTestJSON-1906471331-project Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:54.474919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'server_id': 'a5195b11-b310-408b-a3d8-75d39abd9bba'} Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:07:54.476262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:54.479354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:07:54.482238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Returning 404 to user: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:07:54.482238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ab72d439-0c41-4958-a7dd-5d4e420e0e18 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040175 Sep 14 12:07:54.482238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 153/285] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:07:54 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:07:55.179392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9a4586d6-4ff5-4bf8-a9a3-8d9cc3c016c4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:55.180431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9a4586d6-4ff5-4bf8-a9a3-8d9cc3c016c4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:55.203881 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a4586d6-4ff5-4bf8-a9a3-8d9cc3c016c4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:55.205398 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a4586d6-4ff5-4bf8-a9a3-8d9cc3c016c4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:55.206380 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a4586d6-4ff5-4bf8-a9a3-8d9cc3c016c4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:55.207743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a4586d6-4ff5-4bf8-a9a3-8d9cc3c016c4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:55.208923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a4586d6-4ff5-4bf8-a9a3-8d9cc3c016c4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:55.209693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9a4586d6-4ff5-4bf8-a9a3-8d9cc3c016c4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:55.394752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9a4586d6-4ff5-4bf8-a9a3-8d9cc3c016c4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:55.406100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9a4586d6-4ff5-4bf8-a9a3-8d9cc3c016c4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.230972 Sep 14 12:07:55.406100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 133/286] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:55 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:56.104665 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:56.105184 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:56.113799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:56.114329 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:56.114764 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:56.116039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:56.116310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:56.116737 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:56.132313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] HTTP exception thrown: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Request method failure captured: Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba HTTP/1.1 Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOzjJbsx6UeE4NVDA_2TH_K35YypVZx4KRJ5rqHE-9vKCgiKFyVZt2DzQ7U0IXXEev-Jwgg78NgEtqqo1cXKa9-warjHXASNG4YFxqtEnU8FzqipWo8fZx8FmXE9WdxBgALhi-U5Q1pHr3e0y-sO5Epm2Rdoc6W244DAOchmsr7C98 Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 933ef2ab34a441b982b69839434d689e Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:07:56.134551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/933ef2ab34a441b982b69839434d689e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/933ef2ab34a441b982b69839434d689e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_933ef2ab34a441b982b69839434d689e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/933ef2ab34a441b982b69839434d689e"}]}] Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 933ef2ab34a441b982b69839434d689e Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-DeleteServersTestJSON-1906471331-project Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 5d6b6321705947b6a395f77c11b1c6a5 Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-DeleteServersTestJSON-1906471331-project Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:56.135888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'a5195b11-b310-408b-a3d8-75d39abd9bba'} Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:07:56.136529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:56.137572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:07:56.139327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Returning 404 to user: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:07:56.139327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-92e01925-33ae-4b64-9afc-e541ef88d874 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 404 len: 111 microversion: 2.1 time: 0.035569 Sep 14 12:07:56.139327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 154/287] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:07:56 2022] DELETE /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:07:56.145929 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:56.146842 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] [instance: a5195b11-b310-408b-a3d8-75d39abd9bba] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:56.153914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:56.155600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:56.155600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:56.156413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:56.156947 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:56.157454 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:56.181763 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] HTTP exception thrown: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Request method failure captured: Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba HTTP/1.1 Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcOzjJbsx6UeE4NVDA_2TH_K35YypVZx4KRJ5rqHE-9vKCgiKFyVZt2DzQ7U0IXXEev-Jwgg78NgEtqqo1cXKa9-warjHXASNG4YFxqtEnU8FzqipWo8fZx8FmXE9WdxBgALhi-U5Q1pHr3e0y-sO5Epm2Rdoc6W244DAOchmsr7C98 Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 933ef2ab34a441b982b69839434d689e Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:07:56.183563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/933ef2ab34a441b982b69839434d689e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/933ef2ab34a441b982b69839434d689e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_933ef2ab34a441b982b69839434d689e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/933ef2ab34a441b982b69839434d689e"}]}] Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 933ef2ab34a441b982b69839434d689e Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-DeleteServersTestJSON-1906471331 Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-DeleteServersTestJSON-1906471331-project Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 5d6b6321705947b6a395f77c11b1c6a5 Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-DeleteServersTestJSON-1906471331-project Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:56.185295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': 'a5195b11-b310-408b-a3d8-75d39abd9bba'} Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:07:56.188323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. Sep 14 12:07:56.192843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:07:56.195181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] Returning 404 to user: Instance a5195b11-b310-408b-a3d8-75d39abd9bba could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:07:56.195181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-19209b6f-23bc-43a7-8407-8f7c85540873 tempest-DeleteServersTestJSON-1906471331 tempest-DeleteServersTestJSON-1906471331-project] 10.222.0.62 "GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba" status: 404 len: 111 microversion: 2.1 time: 0.043437 Sep 14 12:07:56.195181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 134/288] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:56 2022] GET /compute/v2.1/servers/a5195b11-b310-408b-a3d8-75d39abd9bba => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:07:56.446836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6838a9cb-f865-4b2e-aad7-a83589aa4f07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:56.447934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6838a9cb-f865-4b2e-aad7-a83589aa4f07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:56.460146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6838a9cb-f865-4b2e-aad7-a83589aa4f07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:56.460948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6838a9cb-f865-4b2e-aad7-a83589aa4f07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:56.462380 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6838a9cb-f865-4b2e-aad7-a83589aa4f07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:56.466130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6838a9cb-f865-4b2e-aad7-a83589aa4f07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:56.468555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6838a9cb-f865-4b2e-aad7-a83589aa4f07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:56.469358 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6838a9cb-f865-4b2e-aad7-a83589aa4f07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:56.651025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6838a9cb-f865-4b2e-aad7-a83589aa4f07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:56.670110 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6838a9cb-f865-4b2e-aad7-a83589aa4f07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.230006 Sep 14 12:07:56.673061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 155/289] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:56 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:57.696950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b5154b32-fd89-4be0-927d-917ab9bda65b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:57.697667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b5154b32-fd89-4be0-927d-917ab9bda65b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:57.706089 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5154b32-fd89-4be0-927d-917ab9bda65b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:57.706585 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5154b32-fd89-4be0-927d-917ab9bda65b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:57.707021 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5154b32-fd89-4be0-927d-917ab9bda65b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:57.707751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5154b32-fd89-4be0-927d-917ab9bda65b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:57.708185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5154b32-fd89-4be0-927d-917ab9bda65b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:57.708592 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5154b32-fd89-4be0-927d-917ab9bda65b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:57.873753 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b5154b32-fd89-4be0-927d-917ab9bda65b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:57.883783 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b5154b32-fd89-4be0-927d-917ab9bda65b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.191085 Sep 14 12:07:57.884487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 135/290] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:57 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:07:58.907945 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-072b40b8-31bf-44b5-978d-22af3195f8c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:07:58.908553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-072b40b8-31bf-44b5-978d-22af3195f8c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:07:58.915934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-072b40b8-31bf-44b5-978d-22af3195f8c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:58.916421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-072b40b8-31bf-44b5-978d-22af3195f8c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:58.916867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-072b40b8-31bf-44b5-978d-22af3195f8c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:58.917703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-072b40b8-31bf-44b5-978d-22af3195f8c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:07:58.918193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-072b40b8-31bf-44b5-978d-22af3195f8c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:07:58.918703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-072b40b8-31bf-44b5-978d-22af3195f8c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:07:59.066852 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-072b40b8-31bf-44b5-978d-22af3195f8c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:07:59.074823 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-072b40b8-31bf-44b5-978d-22af3195f8c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.171515 Sep 14 12:07:59.075408 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 156/291] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:07:58 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:00.098134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-466abc59-32d8-4282-8f14-a80a67ea2872 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:00.099488 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-466abc59-32d8-4282-8f14-a80a67ea2872 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:00.102233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:00.115787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-466abc59-32d8-4282-8f14-a80a67ea2872 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:00.116597 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-466abc59-32d8-4282-8f14-a80a67ea2872 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:00.117547 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-466abc59-32d8-4282-8f14-a80a67ea2872 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:00.118858 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-466abc59-32d8-4282-8f14-a80a67ea2872 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:00.119433 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-466abc59-32d8-4282-8f14-a80a67ea2872 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:00.119997 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-466abc59-32d8-4282-8f14-a80a67ea2872 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:00.320730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-466abc59-32d8-4282-8f14-a80a67ea2872 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:00.365830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-466abc59-32d8-4282-8f14-a80a67ea2872 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.272488 Sep 14 12:08:00.368746 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 136/292] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:00 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:01.415048 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8d626730-cb77-4d4a-b02b-a8e667571f7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:01.415597 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8d626730-cb77-4d4a-b02b-a8e667571f7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:01.422728 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d626730-cb77-4d4a-b02b-a8e667571f7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:01.423286 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d626730-cb77-4d4a-b02b-a8e667571f7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:01.423724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d626730-cb77-4d4a-b02b-a8e667571f7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:01.424420 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d626730-cb77-4d4a-b02b-a8e667571f7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:01.424875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d626730-cb77-4d4a-b02b-a8e667571f7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:01.425301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d626730-cb77-4d4a-b02b-a8e667571f7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:01.663145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8d626730-cb77-4d4a-b02b-a8e667571f7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:01.675925 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8d626730-cb77-4d4a-b02b-a8e667571f7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.265393 Sep 14 12:08:01.703882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 157/293] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:01 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:02.709068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4debaa93-017d-4f7b-b0e4-77ac5b778103 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:02.709701 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4debaa93-017d-4f7b-b0e4-77ac5b778103 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:02.716548 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4debaa93-017d-4f7b-b0e4-77ac5b778103 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:02.718374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4debaa93-017d-4f7b-b0e4-77ac5b778103 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:02.718374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4debaa93-017d-4f7b-b0e4-77ac5b778103 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:02.718805 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4debaa93-017d-4f7b-b0e4-77ac5b778103 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:02.719048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4debaa93-017d-4f7b-b0e4-77ac5b778103 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:02.719467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4debaa93-017d-4f7b-b0e4-77ac5b778103 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:02.938281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4debaa93-017d-4f7b-b0e4-77ac5b778103 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:02.949664 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4debaa93-017d-4f7b-b0e4-77ac5b778103 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.247173 Sep 14 12:08:02.950906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 137/294] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:02 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:03.976363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6130cbf7-12e5-4fcc-9de5-0aa0413f8c71 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:03.977301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6130cbf7-12e5-4fcc-9de5-0aa0413f8c71 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:03.979481 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=48 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:03.985386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6130cbf7-12e5-4fcc-9de5-0aa0413f8c71 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:03.986129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6130cbf7-12e5-4fcc-9de5-0aa0413f8c71 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:03.986814 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6130cbf7-12e5-4fcc-9de5-0aa0413f8c71 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:03.987630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6130cbf7-12e5-4fcc-9de5-0aa0413f8c71 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:03.988213 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6130cbf7-12e5-4fcc-9de5-0aa0413f8c71 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:03.988745 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6130cbf7-12e5-4fcc-9de5-0aa0413f8c71 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:04.147076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6130cbf7-12e5-4fcc-9de5-0aa0413f8c71 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:04.155883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6130cbf7-12e5-4fcc-9de5-0aa0413f8c71 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.183760 Sep 14 12:08:04.156452 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 158/295] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:03 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:05.179941 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c068c8b5-bcc6-4403-8752-d17266ddca36 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:05.181396 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c068c8b5-bcc6-4403-8752-d17266ddca36 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:05.190576 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c068c8b5-bcc6-4403-8752-d17266ddca36 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:05.191535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c068c8b5-bcc6-4403-8752-d17266ddca36 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:05.192622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c068c8b5-bcc6-4403-8752-d17266ddca36 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:05.194550 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c068c8b5-bcc6-4403-8752-d17266ddca36 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:05.195239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c068c8b5-bcc6-4403-8752-d17266ddca36 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:05.195745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c068c8b5-bcc6-4403-8752-d17266ddca36 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:05.368539 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c068c8b5-bcc6-4403-8752-d17266ddca36 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:05.380023 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c068c8b5-bcc6-4403-8752-d17266ddca36 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.204248 Sep 14 12:08:05.394712 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 138/296] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:05 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:06.406814 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9e72bb3b-572d-4d74-823e-9b20bc5c31a4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:06.408007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9e72bb3b-572d-4d74-823e-9b20bc5c31a4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:06.416096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e72bb3b-572d-4d74-823e-9b20bc5c31a4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:06.417210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e72bb3b-572d-4d74-823e-9b20bc5c31a4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:06.417951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e72bb3b-572d-4d74-823e-9b20bc5c31a4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:06.419109 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e72bb3b-572d-4d74-823e-9b20bc5c31a4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:06.420624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e72bb3b-572d-4d74-823e-9b20bc5c31a4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:06.420624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e72bb3b-572d-4d74-823e-9b20bc5c31a4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:06.597032 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9e72bb3b-572d-4d74-823e-9b20bc5c31a4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:06.601006 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:06.606604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9e72bb3b-572d-4d74-823e-9b20bc5c31a4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.205188 Sep 14 12:08:06.608772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 159/297] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:06 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:07.632415 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e2094c40-9fab-4fcb-b20e-3496322d24ec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:07.641450 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e2094c40-9fab-4fcb-b20e-3496322d24ec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:07.645025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e2094c40-9fab-4fcb-b20e-3496322d24ec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:07.646216 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e2094c40-9fab-4fcb-b20e-3496322d24ec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:07.646909 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e2094c40-9fab-4fcb-b20e-3496322d24ec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:07.648029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e2094c40-9fab-4fcb-b20e-3496322d24ec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:07.648659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e2094c40-9fab-4fcb-b20e-3496322d24ec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:07.649454 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e2094c40-9fab-4fcb-b20e-3496322d24ec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:07.995077 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e2094c40-9fab-4fcb-b20e-3496322d24ec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:08.010366 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e2094c40-9fab-4fcb-b20e-3496322d24ec tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.382474 Sep 14 12:08:08.035040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 139/298] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:07 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:09.052199 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a76ecd99-147f-41e7-89b2-ba645bf4416d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:09.053431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a76ecd99-147f-41e7-89b2-ba645bf4416d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:09.062369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a76ecd99-147f-41e7-89b2-ba645bf4416d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:09.063178 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a76ecd99-147f-41e7-89b2-ba645bf4416d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:09.063615 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a76ecd99-147f-41e7-89b2-ba645bf4416d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:09.064575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a76ecd99-147f-41e7-89b2-ba645bf4416d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:09.065191 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a76ecd99-147f-41e7-89b2-ba645bf4416d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:09.065790 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a76ecd99-147f-41e7-89b2-ba645bf4416d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:09.369882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a76ecd99-147f-41e7-89b2-ba645bf4416d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:09.377785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a76ecd99-147f-41e7-89b2-ba645bf4416d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.333199 Sep 14 12:08:09.378775 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 160/299] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:09 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:10.404559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0b6d1889-1752-4628-b262-42a8cdc250cf tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:10.405612 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0b6d1889-1752-4628-b262-42a8cdc250cf tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:10.416397 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b6d1889-1752-4628-b262-42a8cdc250cf tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:10.417144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b6d1889-1752-4628-b262-42a8cdc250cf tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:10.417833 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b6d1889-1752-4628-b262-42a8cdc250cf tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:10.419117 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b6d1889-1752-4628-b262-42a8cdc250cf tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:10.419828 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b6d1889-1752-4628-b262-42a8cdc250cf tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:10.420721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b6d1889-1752-4628-b262-42a8cdc250cf tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:10.700642 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0b6d1889-1752-4628-b262-42a8cdc250cf tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:10.715535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0b6d1889-1752-4628-b262-42a8cdc250cf tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.317250 Sep 14 12:08:10.716882 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 140/300] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:10 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:11.738869 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0bd74b68-9072-47e4-8ce5-e1103dbd947d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:11.739646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0bd74b68-9072-47e4-8ce5-e1103dbd947d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:11.754229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0bd74b68-9072-47e4-8ce5-e1103dbd947d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:11.754229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0bd74b68-9072-47e4-8ce5-e1103dbd947d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:11.754229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0bd74b68-9072-47e4-8ce5-e1103dbd947d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:11.754229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0bd74b68-9072-47e4-8ce5-e1103dbd947d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:11.754591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0bd74b68-9072-47e4-8ce5-e1103dbd947d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:11.754591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0bd74b68-9072-47e4-8ce5-e1103dbd947d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:11.948622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0bd74b68-9072-47e4-8ce5-e1103dbd947d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:11.968783 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0bd74b68-9072-47e4-8ce5-e1103dbd947d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.233962 Sep 14 12:08:11.969622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 161/301] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:11 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:12.754479 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c9017637-7353-452c-af17-1f356269a9ae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: .version_select at 0x7f1c99f12e50>, body: {"keypair": {"name": "tempest-keypair-37883818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIycWStf+UHn2qF8Z15fs+yCm+7NgsAmC1NFP6/SYb+E4pVmQ/ZuZo8XbJQLmvy8sqHV8lqEJ5RIbU29+c4ZtD8C9/mYqaNconVadrIhXX3Cs3OJQ5aMY8ekMdtioiRSA=="}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:12.771511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-c9017637-7353-452c-af17-1f356269a9ae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for project 5b86ec91335c49aaa672aa85461d2936. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:08:12.775943 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-c9017637-7353-452c-af17-1f356269a9ae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for user 31f3271adc36406fb303fb169020e740 and project 5b86ec91335c49aaa672aa85461d2936. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:08:12.852963 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c9017637-7353-452c-af17-1f356269a9ae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.246568 Sep 14 12:08:12.853499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 141/302] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 14 12:08:12 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:08:12.995651 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f488ba1d-39d2-44c9-bded-015fcb7cd7ea tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:12.998556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f488ba1d-39d2-44c9-bded-015fcb7cd7ea tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:13.004973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f488ba1d-39d2-44c9-bded-015fcb7cd7ea tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:13.005459 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f488ba1d-39d2-44c9-bded-015fcb7cd7ea tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:13.006114 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f488ba1d-39d2-44c9-bded-015fcb7cd7ea tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:13.007576 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f488ba1d-39d2-44c9-bded-015fcb7cd7ea tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:13.008042 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f488ba1d-39d2-44c9-bded-015fcb7cd7ea tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:13.008470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f488ba1d-39d2-44c9-bded-015fcb7cd7ea tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:13.176861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f488ba1d-39d2-44c9-bded-015fcb7cd7ea tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:13.184757 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f488ba1d-39d2-44c9-bded-015fcb7cd7ea tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.196814 Sep 14 12:08:13.185323 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 162/303] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:12 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:14.208489 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-30184b55-a3db-40ea-b3dd-206f8046b4b5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:14.209041 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-30184b55-a3db-40ea-b3dd-206f8046b4b5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:14.215956 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30184b55-a3db-40ea-b3dd-206f8046b4b5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:14.216706 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30184b55-a3db-40ea-b3dd-206f8046b4b5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:14.220622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30184b55-a3db-40ea-b3dd-206f8046b4b5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:14.220622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30184b55-a3db-40ea-b3dd-206f8046b4b5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:14.220622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30184b55-a3db-40ea-b3dd-206f8046b4b5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:14.220622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30184b55-a3db-40ea-b3dd-206f8046b4b5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:14.397663 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-30184b55-a3db-40ea-b3dd-206f8046b4b5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:14.411397 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-30184b55-a3db-40ea-b3dd-206f8046b4b5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.206975 Sep 14 12:08:14.412374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 142/304] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:14 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:15.435858 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4c408bc2-9c28-4a03-a45e-df1b3ca2a110 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:15.436449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4c408bc2-9c28-4a03-a45e-df1b3ca2a110 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:15.442635 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c408bc2-9c28-4a03-a45e-df1b3ca2a110 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:15.447058 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c408bc2-9c28-4a03-a45e-df1b3ca2a110 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:15.447058 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c408bc2-9c28-4a03-a45e-df1b3ca2a110 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:15.447058 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c408bc2-9c28-4a03-a45e-df1b3ca2a110 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:15.447058 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c408bc2-9c28-4a03-a45e-df1b3ca2a110 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:15.447385 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c408bc2-9c28-4a03-a45e-df1b3ca2a110 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:15.606239 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4c408bc2-9c28-4a03-a45e-df1b3ca2a110 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:15.614977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4c408bc2-9c28-4a03-a45e-df1b3ca2a110 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.182935 Sep 14 12:08:15.615739 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 163/305] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:15 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:16.412457 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1972472092", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf307d40-f42c-4be6-8979-65e762517b0f"}], "security_groups": [{"name": "tempest-securitygroup--420146813"}], "key_name": "tempest-keypair-37883818", "user_data": "}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:16.544181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] validate_networks() for [('cf307d40-f42c-4be6-8979-65e762517b0f', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:08:16.643265 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5836412c-4cb9-4a69-b65d-c2cf20a7b679 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:16.643880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5836412c-4cb9-4a69-b65d-c2cf20a7b679 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:16.651336 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5836412c-4cb9-4a69-b65d-c2cf20a7b679 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:16.651823 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5836412c-4cb9-4a69-b65d-c2cf20a7b679 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:16.652252 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5836412c-4cb9-4a69-b65d-c2cf20a7b679 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:16.652975 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5836412c-4cb9-4a69-b65d-c2cf20a7b679 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:16.653419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5836412c-4cb9-4a69-b65d-c2cf20a7b679 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:16.653831 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5836412c-4cb9-4a69-b65d-c2cf20a7b679 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:16.939792 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5836412c-4cb9-4a69-b65d-c2cf20a7b679 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:16.951051 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5836412c-4cb9-4a69-b65d-c2cf20a7b679 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.311986 Sep 14 12:08:16.951641 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 164/306] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:16 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:17.094127 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:08:17.094559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:08:17.095032 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:08:17.095440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:08:17.095854 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:08:17.105525 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:17.106048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:17.106486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:17.107224 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:17.107740 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:17.108252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:17.126894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for project 5b86ec91335c49aaa672aa85461d2936. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:08:17.131069 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for user 31f3271adc36406fb303fb169020e740 and project 5b86ec91335c49aaa672aa85461d2936. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:08:17.142939 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:08:17.145248 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:08:17.353758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1fef057e-3822-4afc-bfa5-c78b35855f2c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.946081 Sep 14 12:08:17.355195 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 143/307] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:08:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:08:17.368155 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8179d5aa-8713-44f3-a1e4-c25305f06a58 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:17.368773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8179d5aa-8713-44f3-a1e4-c25305f06a58 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:17.446607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8179d5aa-8713-44f3-a1e4-c25305f06a58 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:17.460124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8179d5aa-8713-44f3-a1e4-c25305f06a58 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1240 microversion: 2.1 time: 0.095972 Sep 14 12:08:17.460728 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 165/308] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:17 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:17.976663 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e09ed4ff-b33d-42f3-829e-f223fcc40648 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:17.977266 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e09ed4ff-b33d-42f3-829e-f223fcc40648 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:17.986504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e09ed4ff-b33d-42f3-829e-f223fcc40648 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:17.986998 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e09ed4ff-b33d-42f3-829e-f223fcc40648 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:17.987445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e09ed4ff-b33d-42f3-829e-f223fcc40648 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:17.988328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e09ed4ff-b33d-42f3-829e-f223fcc40648 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:17.988808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e09ed4ff-b33d-42f3-829e-f223fcc40648 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:17.989261 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e09ed4ff-b33d-42f3-829e-f223fcc40648 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:18.161845 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e09ed4ff-b33d-42f3-829e-f223fcc40648 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:18.172622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e09ed4ff-b33d-42f3-829e-f223fcc40648 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.200558 Sep 14 12:08:18.173213 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 144/309] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:17 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:18.483882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3984fde5-2285-4c7f-8bda-12d936596ab0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:18.484516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3984fde5-2285-4c7f-8bda-12d936596ab0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:18.543615 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3984fde5-2285-4c7f-8bda-12d936596ab0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:18.553608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3984fde5-2285-4c7f-8bda-12d936596ab0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1240 microversion: 2.1 time: 0.073372 Sep 14 12:08:18.554508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 166/310] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:18 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:19.197812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f1427a58-704c-45ed-929f-387129fb3449 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:19.198504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f1427a58-704c-45ed-929f-387129fb3449 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:19.206715 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1427a58-704c-45ed-929f-387129fb3449 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:19.207216 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1427a58-704c-45ed-929f-387129fb3449 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:19.207703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1427a58-704c-45ed-929f-387129fb3449 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:19.208414 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1427a58-704c-45ed-929f-387129fb3449 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:19.208880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1427a58-704c-45ed-929f-387129fb3449 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:19.209314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f1427a58-704c-45ed-929f-387129fb3449 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:19.229377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:19.368412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f1427a58-704c-45ed-929f-387129fb3449 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:19.376888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f1427a58-704c-45ed-929f-387129fb3449 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.183640 Sep 14 12:08:19.377470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 145/311] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:19 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:19.577128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ecb1b1c2-d6c2-4d5b-ba19-7a5e97db41ea tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:19.577646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ecb1b1c2-d6c2-4d5b-ba19-7a5e97db41ea tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:19.583844 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ecb1b1c2-d6c2-4d5b-ba19-7a5e97db41ea tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:19.584332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ecb1b1c2-d6c2-4d5b-ba19-7a5e97db41ea tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:19.584764 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ecb1b1c2-d6c2-4d5b-ba19-7a5e97db41ea tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:19.585451 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ecb1b1c2-d6c2-4d5b-ba19-7a5e97db41ea tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:19.585964 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ecb1b1c2-d6c2-4d5b-ba19-7a5e97db41ea tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:19.586397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ecb1b1c2-d6c2-4d5b-ba19-7a5e97db41ea tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:19.662917 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ecb1b1c2-d6c2-4d5b-ba19-7a5e97db41ea tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:19.671763 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ecb1b1c2-d6c2-4d5b-ba19-7a5e97db41ea tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1292 microversion: 2.1 time: 0.098818 Sep 14 12:08:19.672344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 167/312] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:19 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:20.401357 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8f30daee-7bd5-41cc-8090-a02acfbf4088 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:20.402026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8f30daee-7bd5-41cc-8090-a02acfbf4088 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:20.408664 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8f30daee-7bd5-41cc-8090-a02acfbf4088 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:20.409083 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8f30daee-7bd5-41cc-8090-a02acfbf4088 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:20.409535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8f30daee-7bd5-41cc-8090-a02acfbf4088 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:20.410264 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8f30daee-7bd5-41cc-8090-a02acfbf4088 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:20.410866 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8f30daee-7bd5-41cc-8090-a02acfbf4088 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:20.411290 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8f30daee-7bd5-41cc-8090-a02acfbf4088 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:20.640366 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8f30daee-7bd5-41cc-8090-a02acfbf4088 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:20.649405 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8f30daee-7bd5-41cc-8090-a02acfbf4088 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.252540 Sep 14 12:08:20.650733 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 146/313] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:20 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:20.697218 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-af7e3c70-83b3-44bb-9464-9fde81672384 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:20.698650 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-af7e3c70-83b3-44bb-9464-9fde81672384 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:20.709560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e3c70-83b3-44bb-9464-9fde81672384 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:20.710791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e3c70-83b3-44bb-9464-9fde81672384 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:20.711858 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e3c70-83b3-44bb-9464-9fde81672384 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:20.713421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e3c70-83b3-44bb-9464-9fde81672384 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:20.715357 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e3c70-83b3-44bb-9464-9fde81672384 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:20.716793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e3c70-83b3-44bb-9464-9fde81672384 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:20.839052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-af7e3c70-83b3-44bb-9464-9fde81672384 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:20.851684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-af7e3c70-83b3-44bb-9464-9fde81672384 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1300 microversion: 2.1 time: 0.159584 Sep 14 12:08:20.866148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 168/314] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:20 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:21.674394 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4590d8e1-c133-477c-bac3-30aa19c71afd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:21.674394 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4590d8e1-c133-477c-bac3-30aa19c71afd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:21.681301 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4590d8e1-c133-477c-bac3-30aa19c71afd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:21.681795 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4590d8e1-c133-477c-bac3-30aa19c71afd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:21.682274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4590d8e1-c133-477c-bac3-30aa19c71afd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:21.685128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4590d8e1-c133-477c-bac3-30aa19c71afd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:21.685128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4590d8e1-c133-477c-bac3-30aa19c71afd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:21.685128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4590d8e1-c133-477c-bac3-30aa19c71afd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:21.880147 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1c853836-dd8c-4354-aa67-f2ddf85f08f4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:21.880952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1c853836-dd8c-4354-aa67-f2ddf85f08f4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:21.890013 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c853836-dd8c-4354-aa67-f2ddf85f08f4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:21.897096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c853836-dd8c-4354-aa67-f2ddf85f08f4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:21.897096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c853836-dd8c-4354-aa67-f2ddf85f08f4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:21.897096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c853836-dd8c-4354-aa67-f2ddf85f08f4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:21.897096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c853836-dd8c-4354-aa67-f2ddf85f08f4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:21.898049 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c853836-dd8c-4354-aa67-f2ddf85f08f4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:21.972122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4590d8e1-c133-477c-bac3-30aa19c71afd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:21.998178 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4590d8e1-c133-477c-bac3-30aa19c71afd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.328489 Sep 14 12:08:22.009468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 147/315] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:21 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:22.170125 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1c853836-dd8c-4354-aa67-f2ddf85f08f4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:22.183419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1c853836-dd8c-4354-aa67-f2ddf85f08f4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.307608 Sep 14 12:08:22.184396 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 169/316] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:21 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:23.033223 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-54957cc2-0e03-4dfd-b35c-f597008ca9cb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:23.033987 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-54957cc2-0e03-4dfd-b35c-f597008ca9cb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:23.041571 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54957cc2-0e03-4dfd-b35c-f597008ca9cb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:23.042335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54957cc2-0e03-4dfd-b35c-f597008ca9cb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:23.042840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54957cc2-0e03-4dfd-b35c-f597008ca9cb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:23.043546 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54957cc2-0e03-4dfd-b35c-f597008ca9cb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:23.044012 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54957cc2-0e03-4dfd-b35c-f597008ca9cb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:23.044468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54957cc2-0e03-4dfd-b35c-f597008ca9cb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:23.218842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-efd369a2-2411-47cf-80c9-60b7f0149494 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:23.221242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-efd369a2-2411-47cf-80c9-60b7f0149494 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:23.231875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efd369a2-2411-47cf-80c9-60b7f0149494 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:23.232551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efd369a2-2411-47cf-80c9-60b7f0149494 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:23.233432 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efd369a2-2411-47cf-80c9-60b7f0149494 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:23.234665 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efd369a2-2411-47cf-80c9-60b7f0149494 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:23.235574 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efd369a2-2411-47cf-80c9-60b7f0149494 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:23.236257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efd369a2-2411-47cf-80c9-60b7f0149494 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:23.482511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-54957cc2-0e03-4dfd-b35c-f597008ca9cb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:23.497448 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-54957cc2-0e03-4dfd-b35c-f597008ca9cb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.468365 Sep 14 12:08:23.498522 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 148/317] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:23 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:23.554181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-efd369a2-2411-47cf-80c9-60b7f0149494 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:23.563502 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-efd369a2-2411-47cf-80c9-60b7f0149494 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.351737 Sep 14 12:08:23.564244 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 170/318] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:23 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:24.091738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-d696d023-cff7-4a55-a75d-e9430a1b8407 req-108ece66-0079-4045-bd3a-6de07a81825c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8", "tag": "97f1a3f8-15d4-41fb-82b2-8ab9cec6e359"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:24.102401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d696d023-cff7-4a55-a75d-e9430a1b8407 req-108ece66-0079-4045-bd3a-6de07a81825c service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:24.106709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d696d023-cff7-4a55-a75d-e9430a1b8407 req-108ece66-0079-4045-bd3a-6de07a81825c service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:24.106709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d696d023-cff7-4a55-a75d-e9430a1b8407 req-108ece66-0079-4045-bd3a-6de07a81825c service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:24.118507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-d696d023-cff7-4a55-a75d-e9430a1b8407 req-108ece66-0079-4045-bd3a-6de07a81825c service nova] Creating event network-changed:97f1a3f8-15d4-41fb-82b2-8ab9cec6e359 for instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 on hv-cinder-84496 Sep 14 12:08:24.124560 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-d696d023-cff7-4a55-a75d-e9430a1b8407 req-108ece66-0079-4045-bd3a-6de07a81825c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035809 Sep 14 12:08:24.125177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 149/319] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:08:24.526527 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7e278023-19b9-4567-b68b-63c0cd140b7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:24.527187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7e278023-19b9-4567-b68b-63c0cd140b7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:24.539927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e278023-19b9-4567-b68b-63c0cd140b7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:24.541521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e278023-19b9-4567-b68b-63c0cd140b7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:24.541705 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e278023-19b9-4567-b68b-63c0cd140b7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:24.543080 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e278023-19b9-4567-b68b-63c0cd140b7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:24.543940 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e278023-19b9-4567-b68b-63c0cd140b7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:24.544773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e278023-19b9-4567-b68b-63c0cd140b7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:24.591511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-99f8ebc5-90cb-4de5-8a2b-a6ca0edbd6aa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:24.593671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-99f8ebc5-90cb-4de5-8a2b-a6ca0edbd6aa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:24.607919 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99f8ebc5-90cb-4de5-8a2b-a6ca0edbd6aa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:24.608475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99f8ebc5-90cb-4de5-8a2b-a6ca0edbd6aa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:24.609041 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99f8ebc5-90cb-4de5-8a2b-a6ca0edbd6aa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:24.609682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99f8ebc5-90cb-4de5-8a2b-a6ca0edbd6aa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:24.610161 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99f8ebc5-90cb-4de5-8a2b-a6ca0edbd6aa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:24.617727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99f8ebc5-90cb-4de5-8a2b-a6ca0edbd6aa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:24.902904 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7e278023-19b9-4567-b68b-63c0cd140b7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:24.914835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7e278023-19b9-4567-b68b-63c0cd140b7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1521 microversion: 2.1 time: 0.395412 Sep 14 12:08:24.916238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 171/320] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:24 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:24.947760 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-99f8ebc5-90cb-4de5-8a2b-a6ca0edbd6aa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:24.961932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-99f8ebc5-90cb-4de5-8a2b-a6ca0edbd6aa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.377878 Sep 14 12:08:24.962667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 150/321] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:24 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:25.938632 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d9735b08-9056-4769-af5b-8de6427143aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:25.939767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d9735b08-9056-4769-af5b-8de6427143aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:25.948857 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9735b08-9056-4769-af5b-8de6427143aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:25.949356 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9735b08-9056-4769-af5b-8de6427143aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:25.949797 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9735b08-9056-4769-af5b-8de6427143aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:25.950555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9735b08-9056-4769-af5b-8de6427143aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:25.951011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9735b08-9056-4769-af5b-8de6427143aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:25.951436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d9735b08-9056-4769-af5b-8de6427143aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:26.000697 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-32a5c17b-3552-469b-aec5-b0585ac12c87 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:26.001647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-32a5c17b-3552-469b-aec5-b0585ac12c87 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:26.009881 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a5c17b-3552-469b-aec5-b0585ac12c87 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:26.010420 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a5c17b-3552-469b-aec5-b0585ac12c87 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:26.010886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a5c17b-3552-469b-aec5-b0585ac12c87 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:26.011839 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a5c17b-3552-469b-aec5-b0585ac12c87 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:26.012295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a5c17b-3552-469b-aec5-b0585ac12c87 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:26.012726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a5c17b-3552-469b-aec5-b0585ac12c87 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:26.247215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d9735b08-9056-4769-af5b-8de6427143aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:26.256130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d9735b08-9056-4769-af5b-8de6427143aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1501 microversion: 2.1 time: 0.321480 Sep 14 12:08:26.266060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 172/322] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:25 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1501 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:26.281108 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9492d9e3-dca8-42f0-8b57-86cae328ebc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:26.281727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9492d9e3-dca8-42f0-8b57-86cae328ebc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:26.301955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9492d9e3-dca8-42f0-8b57-86cae328ebc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:26.301955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9492d9e3-dca8-42f0-8b57-86cae328ebc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:26.301955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9492d9e3-dca8-42f0-8b57-86cae328ebc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:26.301955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9492d9e3-dca8-42f0-8b57-86cae328ebc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:26.302334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9492d9e3-dca8-42f0-8b57-86cae328ebc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:26.302334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9492d9e3-dca8-42f0-8b57-86cae328ebc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:26.316555 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-32a5c17b-3552-469b-aec5-b0585ac12c87 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:26.325771 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-32a5c17b-3552-469b-aec5-b0585ac12c87 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.328981 Sep 14 12:08:26.326643 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 151/323] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:25 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:26.472433 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9492d9e3-dca8-42f0-8b57-86cae328ebc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:26.480222 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9492d9e3-dca8-42f0-8b57-86cae328ebc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1516 microversion: 2.1 time: 0.203544 Sep 14 12:08:26.480799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 173/324] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:26 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1516 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:27.354966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ce7a1edd-a684-42b8-8e11-2d0d8631eb85 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:27.356360 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ce7a1edd-a684-42b8-8e11-2d0d8631eb85 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:27.363015 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:27.365543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=10 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:27.365778 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce7a1edd-a684-42b8-8e11-2d0d8631eb85 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:27.366368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce7a1edd-a684-42b8-8e11-2d0d8631eb85 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:27.367051 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce7a1edd-a684-42b8-8e11-2d0d8631eb85 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:27.367923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce7a1edd-a684-42b8-8e11-2d0d8631eb85 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:27.368714 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce7a1edd-a684-42b8-8e11-2d0d8631eb85 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:27.369325 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce7a1edd-a684-42b8-8e11-2d0d8631eb85 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:27.555270 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ce7a1edd-a684-42b8-8e11-2d0d8631eb85 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:27.563676 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ce7a1edd-a684-42b8-8e11-2d0d8631eb85 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.212636 Sep 14 12:08:27.564259 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 152/325] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:27 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:28.589501 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4fd3a011-78b1-40e9-b4b9-c46ff933b538 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:28.590454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4fd3a011-78b1-40e9-b4b9-c46ff933b538 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:28.592349 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=4 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:28.597410 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3a011-78b1-40e9-b4b9-c46ff933b538 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:28.598435 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3a011-78b1-40e9-b4b9-c46ff933b538 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:28.598886 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3a011-78b1-40e9-b4b9-c46ff933b538 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:28.599591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3a011-78b1-40e9-b4b9-c46ff933b538 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:28.600045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3a011-78b1-40e9-b4b9-c46ff933b538 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:28.604777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3a011-78b1-40e9-b4b9-c46ff933b538 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:28.751857 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4fd3a011-78b1-40e9-b4b9-c46ff933b538 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:28.761758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4fd3a011-78b1-40e9-b4b9-c46ff933b538 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.176360 Sep 14 12:08:28.762422 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 174/326] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:28 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:29.519745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8cde012d-9cb8-47ab-8185-ca3d456ef714 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:29.545167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8cde012d-9cb8-47ab-8185-ca3d456ef714 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:29.545167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cde012d-9cb8-47ab-8185-ca3d456ef714 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:29.545167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cde012d-9cb8-47ab-8185-ca3d456ef714 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:29.545167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cde012d-9cb8-47ab-8185-ca3d456ef714 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:29.547089 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cde012d-9cb8-47ab-8185-ca3d456ef714 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:29.547089 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cde012d-9cb8-47ab-8185-ca3d456ef714 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:29.547089 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cde012d-9cb8-47ab-8185-ca3d456ef714 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:29.591573 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-8cde012d-9cb8-47ab-8185-ca3d456ef714 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lazy-loading 'flavor' on Instance uuid 7649ff4f-2137-402c-a210-b4b9f4c95b82 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:08:29.698872 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1983656342", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "networks": [{"uuid": "9135ef43-953f-4132-bfad-90e682eae5df"}]}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:29.773273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.network.neutron [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] validate_networks() for [('9135ef43-953f-4132-bfad-90e682eae5df', None, None, None, None, None)] {{(pid=121152) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:08:30.018849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8cde012d-9cb8-47ab-8185-ca3d456ef714 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82/action" status: 200 len: 32 microversion: 2.1 time: 0.503594 Sep 14 12:08:30.019383 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 153/327] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:08:29 2022] POST /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82/action => generated 32 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 12:08:30.025223 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-32d97b62-3ac1-4d91-a7b6-fcd92b153260 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:30.025913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-32d97b62-3ac1-4d91-a7b6-fcd92b153260 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:30.032450 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32d97b62-3ac1-4d91-a7b6-fcd92b153260 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:30.032936 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32d97b62-3ac1-4d91-a7b6-fcd92b153260 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:30.033375 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32d97b62-3ac1-4d91-a7b6-fcd92b153260 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:30.034157 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32d97b62-3ac1-4d91-a7b6-fcd92b153260 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:30.034613 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32d97b62-3ac1-4d91-a7b6-fcd92b153260 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:30.035037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32d97b62-3ac1-4d91-a7b6-fcd92b153260 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:30.271370 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Flavor limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:08:30.271738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Image limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:08:30.272217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Flavor pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:08:30.272622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Image pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:08:30.273033 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:08:30.283009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:30.283546 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:30.283979 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:30.284711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:30.284883 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-32d97b62-3ac1-4d91-a7b6-fcd92b153260 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:30.285158 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:30.285586 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:30.293338 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-32d97b62-3ac1-4d91-a7b6-fcd92b153260 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.272735 Sep 14 12:08:30.293957 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 154/328] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:30 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:30.298907 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2b435fc4-e6b4-4fc0-9b28-31b51047c392 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:30.299522 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2b435fc4-e6b4-4fc0-9b28-31b51047c392 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:30.304611 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Getting quotas for project 2e692d812c3842608e10769277212d85. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:08:30.308461 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b435fc4-e6b4-4fc0-9b28-31b51047c392 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:30.308461 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b435fc4-e6b4-4fc0-9b28-31b51047c392 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:30.308461 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b435fc4-e6b4-4fc0-9b28-31b51047c392 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:30.308461 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b435fc4-e6b4-4fc0-9b28-31b51047c392 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:30.308931 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b435fc4-e6b4-4fc0-9b28-31b51047c392 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:30.308931 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b435fc4-e6b4-4fc0-9b28-31b51047c392 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:30.310358 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Getting quotas for user e133fb1749004c36a38ac028782294e2 and project 2e692d812c3842608e10769277212d85. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:08:30.322545 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Going to run 1 instances... {{(pid=121152) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:08:30.326138 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:08:30.448142 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2b435fc4-e6b4-4fc0-9b28-31b51047c392 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:30.456435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2b435fc4-e6b4-4fc0-9b28-31b51047c392 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.161456 Sep 14 12:08:30.457056 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 155/329] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:30 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:30.461818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-195c0575-a2f1-4b1c-80a5-ec5d6e2d4b2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779072 Sep 14 12:08:30.468627 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 175/330] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:08:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:08:30.476332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-13fb2425-72f2-4cca-b72f-77f29f339a14 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:30.476939 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-13fb2425-72f2-4cca-b72f-77f29f339a14 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:30.535391 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13fb2425-72f2-4cca-b72f-77f29f339a14 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:30.544826 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-13fb2425-72f2-4cca-b72f-77f29f339a14 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1214 microversion: 2.1 time: 0.072169 Sep 14 12:08:30.545922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 156/331] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:30 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:31.318608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-06974e51-2088-47d0-b494-85535b2800be tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:31.319276 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-06974e51-2088-47d0-b494-85535b2800be tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:31.325475 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06974e51-2088-47d0-b494-85535b2800be tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:31.326323 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06974e51-2088-47d0-b494-85535b2800be tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:31.326974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06974e51-2088-47d0-b494-85535b2800be tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:31.328469 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06974e51-2088-47d0-b494-85535b2800be tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:31.328950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06974e51-2088-47d0-b494-85535b2800be tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:31.329540 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06974e51-2088-47d0-b494-85535b2800be tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:31.479221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7501a375-9ef3-405d-81a6-2b6de8b7ff07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:31.479831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7501a375-9ef3-405d-81a6-2b6de8b7ff07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:31.490043 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7501a375-9ef3-405d-81a6-2b6de8b7ff07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:31.490973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7501a375-9ef3-405d-81a6-2b6de8b7ff07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:31.492052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7501a375-9ef3-405d-81a6-2b6de8b7ff07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:31.493367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7501a375-9ef3-405d-81a6-2b6de8b7ff07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:31.494292 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7501a375-9ef3-405d-81a6-2b6de8b7ff07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:31.495157 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7501a375-9ef3-405d-81a6-2b6de8b7ff07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:31.638844 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-06974e51-2088-47d0-b494-85535b2800be tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:31.647431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-06974e51-2088-47d0-b494-85535b2800be tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.332687 Sep 14 12:08:31.648146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 176/332] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:31 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:31.660468 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8f68d3d9-3bb4-476e-83fa-c8898ee06b40 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:31.661518 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8f68d3d9-3bb4-476e-83fa-c8898ee06b40 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:31.751301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8f68d3d9-3bb4-476e-83fa-c8898ee06b40 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:31.759044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8f68d3d9-3bb4-476e-83fa-c8898ee06b40 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1214 microversion: 2.1 time: 0.108094 Sep 14 12:08:31.774949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 177/333] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:31 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:31.857500 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7501a375-9ef3-405d-81a6-2b6de8b7ff07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:31.866354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7501a375-9ef3-405d-81a6-2b6de8b7ff07 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.391145 Sep 14 12:08:31.867225 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 157/334] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:31 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:32.671526 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-807230aa-3b16-450d-a3ce-586d6bdb7c36 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:32.672134 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-807230aa-3b16-450d-a3ce-586d6bdb7c36 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:32.678180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-807230aa-3b16-450d-a3ce-586d6bdb7c36 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:32.678671 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-807230aa-3b16-450d-a3ce-586d6bdb7c36 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:32.679101 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-807230aa-3b16-450d-a3ce-586d6bdb7c36 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:32.679916 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-807230aa-3b16-450d-a3ce-586d6bdb7c36 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:32.680367 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-807230aa-3b16-450d-a3ce-586d6bdb7c36 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:32.680987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-807230aa-3b16-450d-a3ce-586d6bdb7c36 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:32.784328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-41f01dee-3e53-40ba-89d7-73c7469b99ff tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:32.784955 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-41f01dee-3e53-40ba-89d7-73c7469b99ff tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:32.792649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41f01dee-3e53-40ba-89d7-73c7469b99ff tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:32.793149 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41f01dee-3e53-40ba-89d7-73c7469b99ff tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:32.793594 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41f01dee-3e53-40ba-89d7-73c7469b99ff tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:32.794690 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41f01dee-3e53-40ba-89d7-73c7469b99ff tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:32.795190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41f01dee-3e53-40ba-89d7-73c7469b99ff tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:32.795660 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-41f01dee-3e53-40ba-89d7-73c7469b99ff tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:33.041376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-41f01dee-3e53-40ba-89d7-73c7469b99ff tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:33.055758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-41f01dee-3e53-40ba-89d7-73c7469b99ff tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1210 microversion: 2.1 time: 0.275916 Sep 14 12:08:33.056649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 158/335] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:32 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1210 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:33.069083 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f11c5ab4-da79-4422-a206-ca713a011a5d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:33.070192 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f11c5ab4-da79-4422-a206-ca713a011a5d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:33.077957 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f11c5ab4-da79-4422-a206-ca713a011a5d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:33.078710 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f11c5ab4-da79-4422-a206-ca713a011a5d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:33.079432 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f11c5ab4-da79-4422-a206-ca713a011a5d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:33.080421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f11c5ab4-da79-4422-a206-ca713a011a5d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:33.081260 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f11c5ab4-da79-4422-a206-ca713a011a5d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:33.081782 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f11c5ab4-da79-4422-a206-ca713a011a5d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:33.218384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-807230aa-3b16-450d-a3ce-586d6bdb7c36 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:33.231983 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-807230aa-3b16-450d-a3ce-586d6bdb7c36 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.564830 Sep 14 12:08:33.246810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 178/336] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:32 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:33.334522 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f11c5ab4-da79-4422-a206-ca713a011a5d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:33.343468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f11c5ab4-da79-4422-a206-ca713a011a5d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.285615 Sep 14 12:08:33.344239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 159/337] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:33 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:34.088934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-75819587-79d3-42e8-813f-9463b9d91e0d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:34.089543 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-75819587-79d3-42e8-813f-9463b9d91e0d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:34.096037 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75819587-79d3-42e8-813f-9463b9d91e0d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:34.096513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75819587-79d3-42e8-813f-9463b9d91e0d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:34.096945 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75819587-79d3-42e8-813f-9463b9d91e0d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:34.097639 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75819587-79d3-42e8-813f-9463b9d91e0d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:34.098115 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75819587-79d3-42e8-813f-9463b9d91e0d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:34.098536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75819587-79d3-42e8-813f-9463b9d91e0d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:34.161591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-75819587-79d3-42e8-813f-9463b9d91e0d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:34.169553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-75819587-79d3-42e8-813f-9463b9d91e0d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1266 microversion: 2.1 time: 0.084519 Sep 14 12:08:34.170168 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 179/338] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:34 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:34.259592 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-858e9702-66cd-4a3f-b5b6-893c4b43cd1e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:34.260186 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-858e9702-66cd-4a3f-b5b6-893c4b43cd1e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:34.267516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-858e9702-66cd-4a3f-b5b6-893c4b43cd1e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:34.268028 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-858e9702-66cd-4a3f-b5b6-893c4b43cd1e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:34.268482 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-858e9702-66cd-4a3f-b5b6-893c4b43cd1e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:34.273017 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-858e9702-66cd-4a3f-b5b6-893c4b43cd1e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:34.273017 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-858e9702-66cd-4a3f-b5b6-893c4b43cd1e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:34.273017 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-858e9702-66cd-4a3f-b5b6-893c4b43cd1e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:34.379999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d56e36d4-6b4c-4dd6-9e02-2c32ab8c4346 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:34.380902 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d56e36d4-6b4c-4dd6-9e02-2c32ab8c4346 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:34.389111 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d56e36d4-6b4c-4dd6-9e02-2c32ab8c4346 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:34.395738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d56e36d4-6b4c-4dd6-9e02-2c32ab8c4346 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:34.395738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d56e36d4-6b4c-4dd6-9e02-2c32ab8c4346 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:34.395738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d56e36d4-6b4c-4dd6-9e02-2c32ab8c4346 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:34.395738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d56e36d4-6b4c-4dd6-9e02-2c32ab8c4346 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:34.396097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d56e36d4-6b4c-4dd6-9e02-2c32ab8c4346 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:34.401245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:34.424136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-858e9702-66cd-4a3f-b5b6-893c4b43cd1e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:34.442274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-858e9702-66cd-4a3f-b5b6-893c4b43cd1e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.186443 Sep 14 12:08:34.443911 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 160/339] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:34 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:34.649194 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d56e36d4-6b4c-4dd6-9e02-2c32ab8c4346 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:34.661181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d56e36d4-6b4c-4dd6-9e02-2c32ab8c4346 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.287153 Sep 14 12:08:34.663647 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 180/340] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:34 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:35.194083 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-13f0b095-d66e-41c0-8e98-96c8f8c0c354 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:35.195906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-13f0b095-d66e-41c0-8e98-96c8f8c0c354 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:35.198514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:35.206068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13f0b095-d66e-41c0-8e98-96c8f8c0c354 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:35.206569 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13f0b095-d66e-41c0-8e98-96c8f8c0c354 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:35.207014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13f0b095-d66e-41c0-8e98-96c8f8c0c354 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:35.207727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13f0b095-d66e-41c0-8e98-96c8f8c0c354 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:35.208180 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13f0b095-d66e-41c0-8e98-96c8f8c0c354 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:35.208598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13f0b095-d66e-41c0-8e98-96c8f8c0c354 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:35.300348 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13f0b095-d66e-41c0-8e98-96c8f8c0c354 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:35.307644 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:35.310321 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-13f0b095-d66e-41c0-8e98-96c8f8c0c354 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1274 microversion: 2.1 time: 0.121328 Sep 14 12:08:35.315481 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 161/341] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:35 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1274 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:35.475124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ed837cbc-14e5-47f0-a240-b6b68a8d50c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:35.477600 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ed837cbc-14e5-47f0-a240-b6b68a8d50c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:35.484554 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed837cbc-14e5-47f0-a240-b6b68a8d50c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:35.485203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed837cbc-14e5-47f0-a240-b6b68a8d50c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:35.485698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed837cbc-14e5-47f0-a240-b6b68a8d50c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:35.486445 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed837cbc-14e5-47f0-a240-b6b68a8d50c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:35.486907 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed837cbc-14e5-47f0-a240-b6b68a8d50c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:35.487332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed837cbc-14e5-47f0-a240-b6b68a8d50c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:35.677974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ed837cbc-14e5-47f0-a240-b6b68a8d50c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:35.687392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9977eff1-8afe-499b-a7ff-e834c267ae9e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:35.688416 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9977eff1-8afe-499b-a7ff-e834c267ae9e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:35.697517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ed837cbc-14e5-47f0-a240-b6b68a8d50c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.228076 Sep 14 12:08:35.700920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 181/342] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:35 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:35.726405 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9977eff1-8afe-499b-a7ff-e834c267ae9e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:35.726981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9977eff1-8afe-499b-a7ff-e834c267ae9e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:35.727862 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9977eff1-8afe-499b-a7ff-e834c267ae9e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:35.728788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9977eff1-8afe-499b-a7ff-e834c267ae9e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:35.729445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9977eff1-8afe-499b-a7ff-e834c267ae9e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:35.730365 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9977eff1-8afe-499b-a7ff-e834c267ae9e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:35.945668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9977eff1-8afe-499b-a7ff-e834c267ae9e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:35.955896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9977eff1-8afe-499b-a7ff-e834c267ae9e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.274326 Sep 14 12:08:35.956849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 162/343] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:35 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:36.338866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-049d8c80-975f-48b5-a947-f882f25753f3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:36.339466 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-049d8c80-975f-48b5-a947-f882f25753f3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:36.345906 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-049d8c80-975f-48b5-a947-f882f25753f3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:36.346394 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-049d8c80-975f-48b5-a947-f882f25753f3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:36.346825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-049d8c80-975f-48b5-a947-f882f25753f3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:36.347573 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-049d8c80-975f-48b5-a947-f882f25753f3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:36.348075 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-049d8c80-975f-48b5-a947-f882f25753f3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:36.348492 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-049d8c80-975f-48b5-a947-f882f25753f3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:36.511910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-049d8c80-975f-48b5-a947-f882f25753f3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:36.522610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-049d8c80-975f-48b5-a947-f882f25753f3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.187557 Sep 14 12:08:36.524325 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 182/344] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:36 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:36.663101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-8f1d2318-172c-493f-851c-9c11c08bb8d5 req-f57f81b0-7fb9-4117-b69a-e9e7125745f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8", "name": "network-vif-plugged", "status": "completed", "tag": "97f1a3f8-15d4-41fb-82b2-8ab9cec6e359"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:36.677159 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-8f1d2318-172c-493f-851c-9c11c08bb8d5 req-f57f81b0-7fb9-4117-b69a-e9e7125745f6 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:36.678336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-8f1d2318-172c-493f-851c-9c11c08bb8d5 req-f57f81b0-7fb9-4117-b69a-e9e7125745f6 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:36.678988 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-8f1d2318-172c-493f-851c-9c11c08bb8d5 req-f57f81b0-7fb9-4117-b69a-e9e7125745f6 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:36.693151 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-8f1d2318-172c-493f-851c-9c11c08bb8d5 req-f57f81b0-7fb9-4117-b69a-e9e7125745f6 service nova] Creating event network-vif-plugged:97f1a3f8-15d4-41fb-82b2-8ab9cec6e359 for instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 on hv-cinder-84496 Sep 14 12:08:36.699101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-8f1d2318-172c-493f-851c-9c11c08bb8d5 req-f57f81b0-7fb9-4117-b69a-e9e7125745f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040240 Sep 14 12:08:36.699930 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 163/345] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:08:36.731183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ce148463-b2ce-4ca1-872c-54a2f85a98e0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:36.732121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ce148463-b2ce-4ca1-872c-54a2f85a98e0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:36.736128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:36.751811 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce148463-b2ce-4ca1-872c-54a2f85a98e0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:36.759229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce148463-b2ce-4ca1-872c-54a2f85a98e0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:36.765255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce148463-b2ce-4ca1-872c-54a2f85a98e0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:36.766333 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce148463-b2ce-4ca1-872c-54a2f85a98e0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:36.766809 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce148463-b2ce-4ca1-872c-54a2f85a98e0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:36.767417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce148463-b2ce-4ca1-872c-54a2f85a98e0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:36.981192 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-16db1654-0ee7-4807-95a7-2c55add919b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:36.981815 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-16db1654-0ee7-4807-95a7-2c55add919b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:36.992723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16db1654-0ee7-4807-95a7-2c55add919b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:36.993541 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16db1654-0ee7-4807-95a7-2c55add919b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:36.994997 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16db1654-0ee7-4807-95a7-2c55add919b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:36.995731 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16db1654-0ee7-4807-95a7-2c55add919b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:36.996072 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ce148463-b2ce-4ca1-872c-54a2f85a98e0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:36.996402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16db1654-0ee7-4807-95a7-2c55add919b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:36.996623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16db1654-0ee7-4807-95a7-2c55add919b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:37.007567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ce148463-b2ce-4ca1-872c-54a2f85a98e0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.280324 Sep 14 12:08:37.008195 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 183/346] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:36 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:37.112471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-35af7e52-e164-42f7-98d3-8f0f0daad1c6 req-2de62d35-4cd6-468e-831b-8706e03a10fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db89dc1f-418a-4442-835d-d99bf7ccba9e", "tag": "6ebf8114-6c7f-4cff-8ace-8be1c4341b8b"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:37.123548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-35af7e52-e164-42f7-98d3-8f0f0daad1c6 req-2de62d35-4cd6-468e-831b-8706e03a10fb service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:37.124157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-35af7e52-e164-42f7-98d3-8f0f0daad1c6 req-2de62d35-4cd6-468e-831b-8706e03a10fb service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:37.124660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-35af7e52-e164-42f7-98d3-8f0f0daad1c6 req-2de62d35-4cd6-468e-831b-8706e03a10fb service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:37.150415 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-35af7e52-e164-42f7-98d3-8f0f0daad1c6 req-2de62d35-4cd6-468e-831b-8706e03a10fb service nova] Creating event network-changed:6ebf8114-6c7f-4cff-8ace-8be1c4341b8b for instance db89dc1f-418a-4442-835d-d99bf7ccba9e on hv-cinder-84496 Sep 14 12:08:37.160237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-35af7e52-e164-42f7-98d3-8f0f0daad1c6 req-2de62d35-4cd6-468e-831b-8706e03a10fb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050760 Sep 14 12:08:37.161336 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 184/347] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:08:37.326801 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-16db1654-0ee7-4807-95a7-2c55add919b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:37.326801 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-16db1654-0ee7-4807-95a7-2c55add919b0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.345230 Sep 14 12:08:37.326801 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 164/348] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:36 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:37.548124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0c799bf9-a2cc-4621-a436-6b116ed9ad87 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:37.548927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0c799bf9-a2cc-4621-a436-6b116ed9ad87 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:37.555366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c799bf9-a2cc-4621-a436-6b116ed9ad87 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:37.555857 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c799bf9-a2cc-4621-a436-6b116ed9ad87 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:37.556296 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c799bf9-a2cc-4621-a436-6b116ed9ad87 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:37.557016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c799bf9-a2cc-4621-a436-6b116ed9ad87 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:37.557576 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c799bf9-a2cc-4621-a436-6b116ed9ad87 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:37.557977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c799bf9-a2cc-4621-a436-6b116ed9ad87 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:37.709396 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0c799bf9-a2cc-4621-a436-6b116ed9ad87 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:37.717092 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0c799bf9-a2cc-4621-a436-6b116ed9ad87 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.173934 Sep 14 12:08:37.717682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 185/349] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:37 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:38.033398 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c8e08b50-9296-49b6-b9ce-e805d1367d60 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:38.034269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c8e08b50-9296-49b6-b9ce-e805d1367d60 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:38.041099 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8e08b50-9296-49b6-b9ce-e805d1367d60 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:38.041634 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8e08b50-9296-49b6-b9ce-e805d1367d60 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:38.042097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8e08b50-9296-49b6-b9ce-e805d1367d60 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:38.042794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8e08b50-9296-49b6-b9ce-e805d1367d60 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:38.043247 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8e08b50-9296-49b6-b9ce-e805d1367d60 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:38.043672 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8e08b50-9296-49b6-b9ce-e805d1367d60 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:38.188476 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c8e08b50-9296-49b6-b9ce-e805d1367d60 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:38.195216 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c8e08b50-9296-49b6-b9ce-e805d1367d60 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.166499 Sep 14 12:08:38.196054 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 165/350] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:38 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:38.353082 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-78b9c8f4-207d-4ddf-aede-42b74058aa2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:38.354189 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-78b9c8f4-207d-4ddf-aede-42b74058aa2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:38.363293 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78b9c8f4-207d-4ddf-aede-42b74058aa2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:38.363791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78b9c8f4-207d-4ddf-aede-42b74058aa2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:38.369454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78b9c8f4-207d-4ddf-aede-42b74058aa2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:38.369454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78b9c8f4-207d-4ddf-aede-42b74058aa2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:38.369454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78b9c8f4-207d-4ddf-aede-42b74058aa2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:38.369454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78b9c8f4-207d-4ddf-aede-42b74058aa2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:38.554309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-78b9c8f4-207d-4ddf-aede-42b74058aa2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:38.562811 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-78b9c8f4-207d-4ddf-aede-42b74058aa2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.216928 Sep 14 12:08:38.563755 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 186/351] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:38 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:38.740618 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ef3cf556-a505-4c37-bc20-b60857f3b7bc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:38.741225 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ef3cf556-a505-4c37-bc20-b60857f3b7bc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:38.747654 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef3cf556-a505-4c37-bc20-b60857f3b7bc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:38.748139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef3cf556-a505-4c37-bc20-b60857f3b7bc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:38.748574 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef3cf556-a505-4c37-bc20-b60857f3b7bc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:38.749814 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef3cf556-a505-4c37-bc20-b60857f3b7bc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:38.750318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef3cf556-a505-4c37-bc20-b60857f3b7bc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:38.750886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef3cf556-a505-4c37-bc20-b60857f3b7bc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:38.901200 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ef3cf556-a505-4c37-bc20-b60857f3b7bc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:38.917074 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ef3cf556-a505-4c37-bc20-b60857f3b7bc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.177039 Sep 14 12:08:38.917761 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 166/352] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:38 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:39.219243 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ac771b01-9c5d-427d-83c0-07771f71b081 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:39.219703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ac771b01-9c5d-427d-83c0-07771f71b081 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:39.225671 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac771b01-9c5d-427d-83c0-07771f71b081 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:39.226193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac771b01-9c5d-427d-83c0-07771f71b081 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:39.226628 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac771b01-9c5d-427d-83c0-07771f71b081 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:39.227328 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac771b01-9c5d-427d-83c0-07771f71b081 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:39.227840 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac771b01-9c5d-427d-83c0-07771f71b081 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:39.238114 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac771b01-9c5d-427d-83c0-07771f71b081 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:39.382852 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ac771b01-9c5d-427d-83c0-07771f71b081 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:39.391629 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ac771b01-9c5d-427d-83c0-07771f71b081 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.176498 Sep 14 12:08:39.392291 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 187/353] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:39 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:39.586276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f8447544-5628-4ad3-92c0-f27df0a260c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:39.587172 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f8447544-5628-4ad3-92c0-f27df0a260c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:39.595613 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8447544-5628-4ad3-92c0-f27df0a260c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:39.596112 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8447544-5628-4ad3-92c0-f27df0a260c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:39.596553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8447544-5628-4ad3-92c0-f27df0a260c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:39.597284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8447544-5628-4ad3-92c0-f27df0a260c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:39.597738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8447544-5628-4ad3-92c0-f27df0a260c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:39.598283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8447544-5628-4ad3-92c0-f27df0a260c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:39.834422 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f8447544-5628-4ad3-92c0-f27df0a260c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:39.844559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f8447544-5628-4ad3-92c0-f27df0a260c8 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.262218 Sep 14 12:08:39.855095 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 167/354] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:39 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:39.941786 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-24064b1d-3945-4078-a7aa-0371e5ba540f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:39.942474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-24064b1d-3945-4078-a7aa-0371e5ba540f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:39.949236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-24064b1d-3945-4078-a7aa-0371e5ba540f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:39.949822 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-24064b1d-3945-4078-a7aa-0371e5ba540f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:39.950406 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-24064b1d-3945-4078-a7aa-0371e5ba540f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:39.951237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-24064b1d-3945-4078-a7aa-0371e5ba540f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:39.951798 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-24064b1d-3945-4078-a7aa-0371e5ba540f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:39.952282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-24064b1d-3945-4078-a7aa-0371e5ba540f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:40.111427 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-24064b1d-3945-4078-a7aa-0371e5ba540f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:40.120811 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-24064b1d-3945-4078-a7aa-0371e5ba540f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.182703 Sep 14 12:08:40.121419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 188/355] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:39 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:40.183787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-932795621", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "networks": [{"uuid": "39f8e997-0bf2-4e00-afc8-b558c863face"}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:40.241139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] validate_networks() for [('39f8e997-0bf2-4e00-afc8-b558c863face', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:08:40.416642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-31193e47-0772-4243-9a2d-cecc7e99878d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:40.417259 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-31193e47-0772-4243-9a2d-cecc7e99878d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:40.419296 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:40.424804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31193e47-0772-4243-9a2d-cecc7e99878d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:40.425289 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31193e47-0772-4243-9a2d-cecc7e99878d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:40.425712 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31193e47-0772-4243-9a2d-cecc7e99878d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:40.426450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31193e47-0772-4243-9a2d-cecc7e99878d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:40.426893 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31193e47-0772-4243-9a2d-cecc7e99878d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:40.427310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31193e47-0772-4243-9a2d-cecc7e99878d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:40.544502 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:40.647845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-31193e47-0772-4243-9a2d-cecc7e99878d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:40.657067 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-31193e47-0772-4243-9a2d-cecc7e99878d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1365 microversion: 2.1 time: 0.244170 Sep 14 12:08:40.680555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 189/356] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:40 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:40.699881 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:08:40.700587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:08:40.701007 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:08:40.702294 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:08:40.702924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:08:40.712954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:40.713475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:40.713951 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:40.714808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:40.715305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:40.715785 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:40.734056 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Getting quotas for project 1488f00baa934f2e9b910644a179c755. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:08:40.738492 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Getting quotas for user 8fe575351bdc456682db592f0c723ea6 and project 1488f00baa934f2e9b910644a179c755. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:08:40.750096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:08:40.752457 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:08:40.871188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c28f27d1-8887-41a6-942d-c6d08894d638 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:40.871188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c28f27d1-8887-41a6-942d-c6d08894d638 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:40.873332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c28f27d1-8887-41a6-942d-c6d08894d638 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:40.873848 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c28f27d1-8887-41a6-942d-c6d08894d638 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:40.874315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c28f27d1-8887-41a6-942d-c6d08894d638 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:40.875016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c28f27d1-8887-41a6-942d-c6d08894d638 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:40.875469 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c28f27d1-8887-41a6-942d-c6d08894d638 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:40.875892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c28f27d1-8887-41a6-942d-c6d08894d638 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:40.943893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6b7dcd1e-a6b0-43ad-ae14-c67c245c68a3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763941 Sep 14 12:08:40.945087 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 168/357] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:08:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:08:40.958009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-faf5cd8f-2fd2-43ed-81f9-ef7afb95edd6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:40.958659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-faf5cd8f-2fd2-43ed-81f9-ef7afb95edd6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:41.021340 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-faf5cd8f-2fd2-43ed-81f9-ef7afb95edd6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:41.030421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-faf5cd8f-2fd2-43ed-81f9-ef7afb95edd6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1218 microversion: 2.1 time: 0.076570 Sep 14 12:08:41.035513 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 169/358] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:40 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:41.073927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c28f27d1-8887-41a6-942d-c6d08894d638 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:41.083272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c28f27d1-8887-41a6-942d-c6d08894d638 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.220464 Sep 14 12:08:41.088057 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 190/359] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:40 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:41.148109 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d4a90bed-b6bb-4380-a0b0-46088cd9dea6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:41.148730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d4a90bed-b6bb-4380-a0b0-46088cd9dea6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:41.155630 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a90bed-b6bb-4380-a0b0-46088cd9dea6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:41.156122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a90bed-b6bb-4380-a0b0-46088cd9dea6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:41.156566 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a90bed-b6bb-4380-a0b0-46088cd9dea6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:41.158707 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a90bed-b6bb-4380-a0b0-46088cd9dea6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:41.158707 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a90bed-b6bb-4380-a0b0-46088cd9dea6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:41.158707 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4a90bed-b6bb-4380-a0b0-46088cd9dea6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:41.297371 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d4a90bed-b6bb-4380-a0b0-46088cd9dea6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:41.305157 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d4a90bed-b6bb-4380-a0b0-46088cd9dea6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.160902 Sep 14 12:08:41.305727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 170/360] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:41 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:41.682334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c2561149-5e4d-47c5-8d0f-2ab57ba6b1a1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:41.682987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c2561149-5e4d-47c5-8d0f-2ab57ba6b1a1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:41.689255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2561149-5e4d-47c5-8d0f-2ab57ba6b1a1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:41.689745 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2561149-5e4d-47c5-8d0f-2ab57ba6b1a1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:41.695920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2561149-5e4d-47c5-8d0f-2ab57ba6b1a1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:41.695920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2561149-5e4d-47c5-8d0f-2ab57ba6b1a1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:41.695920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2561149-5e4d-47c5-8d0f-2ab57ba6b1a1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:41.695920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2561149-5e4d-47c5-8d0f-2ab57ba6b1a1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:41.759125 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=8 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:41.822413 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c2561149-5e4d-47c5-8d0f-2ab57ba6b1a1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:41.830983 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c2561149-5e4d-47c5-8d0f-2ab57ba6b1a1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1555 microversion: 2.1 time: 0.152858 Sep 14 12:08:41.831709 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 191/361] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:41 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:41.864522 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-012e00a2-3d4a-4d13-b7fb-a1e1d487b224 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:41.865089 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-012e00a2-3d4a-4d13-b7fb-a1e1d487b224 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:41.871395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-012e00a2-3d4a-4d13-b7fb-a1e1d487b224 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:41.871875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-012e00a2-3d4a-4d13-b7fb-a1e1d487b224 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:41.872309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-012e00a2-3d4a-4d13-b7fb-a1e1d487b224 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:41.872996 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-012e00a2-3d4a-4d13-b7fb-a1e1d487b224 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:41.873593 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-012e00a2-3d4a-4d13-b7fb-a1e1d487b224 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:41.874072 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-012e00a2-3d4a-4d13-b7fb-a1e1d487b224 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:41.957772 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-012e00a2-3d4a-4d13-b7fb-a1e1d487b224 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096826 Sep 14 12:08:41.958722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 171/362] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 14 12:08:41 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:08:42.055550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6170561c-de23-4b8c-97bc-3d221e0d256e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:42.056358 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6170561c-de23-4b8c-97bc-3d221e0d256e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:42.105893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-36e58894-4ecd-4673-848c-661820796f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:42.106711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-36e58894-4ecd-4673-848c-661820796f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:42.125253 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36e58894-4ecd-4673-848c-661820796f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:42.125753 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36e58894-4ecd-4673-848c-661820796f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:42.126230 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36e58894-4ecd-4673-848c-661820796f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:42.126934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36e58894-4ecd-4673-848c-661820796f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:42.127383 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36e58894-4ecd-4673-848c-661820796f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:42.127806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-36e58894-4ecd-4673-848c-661820796f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:42.129455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6170561c-de23-4b8c-97bc-3d221e0d256e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:42.136729 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6170561c-de23-4b8c-97bc-3d221e0d256e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1218 microversion: 2.1 time: 0.087131 Sep 14 12:08:42.137347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 192/363] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:42 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:42.329547 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-16df1697-31ac-4782-8a75-f01b03bbced6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:42.330552 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-16df1697-31ac-4782-8a75-f01b03bbced6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:42.337610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-16df1697-31ac-4782-8a75-f01b03bbced6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:42.338157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-16df1697-31ac-4782-8a75-f01b03bbced6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:42.338596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-16df1697-31ac-4782-8a75-f01b03bbced6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:42.339344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-16df1697-31ac-4782-8a75-f01b03bbced6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:42.340002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-16df1697-31ac-4782-8a75-f01b03bbced6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:42.340427 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-16df1697-31ac-4782-8a75-f01b03bbced6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:42.610643 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-36e58894-4ecd-4673-848c-661820796f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:42.613160 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-36e58894-4ecd-4673-848c-661820796f0b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.511126 Sep 14 12:08:42.616704 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 172/364] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:42 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:42.634085 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-16df1697-31ac-4782-8a75-f01b03bbced6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:42.643061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-16df1697-31ac-4782-8a75-f01b03bbced6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.318056 Sep 14 12:08:42.701896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 193/365] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:42 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:43.162950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d6cf6eaf-b87f-41d5-9a13-b149c55e241b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:43.163677 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d6cf6eaf-b87f-41d5-9a13-b149c55e241b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:43.172194 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6cf6eaf-b87f-41d5-9a13-b149c55e241b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:43.172786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6cf6eaf-b87f-41d5-9a13-b149c55e241b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:43.173279 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6cf6eaf-b87f-41d5-9a13-b149c55e241b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:43.174028 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6cf6eaf-b87f-41d5-9a13-b149c55e241b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:43.174489 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6cf6eaf-b87f-41d5-9a13-b149c55e241b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:43.174989 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6cf6eaf-b87f-41d5-9a13-b149c55e241b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:43.242370 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d6cf6eaf-b87f-41d5-9a13-b149c55e241b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:43.250620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d6cf6eaf-b87f-41d5-9a13-b149c55e241b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1222 microversion: 2.1 time: 0.091924 Sep 14 12:08:43.251464 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 173/366] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:43 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:43.533185 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-b30f6e6a-cab5-4aca-8b4e-f32f2283b573 req-ed73fbf9-ea31-42ff-8d1c-4d8121b40665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8", "tag": "97f1a3f8-15d4-41fb-82b2-8ab9cec6e359"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:43.549052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b30f6e6a-cab5-4aca-8b4e-f32f2283b573 req-ed73fbf9-ea31-42ff-8d1c-4d8121b40665 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:43.549529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b30f6e6a-cab5-4aca-8b4e-f32f2283b573 req-ed73fbf9-ea31-42ff-8d1c-4d8121b40665 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:43.549989 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b30f6e6a-cab5-4aca-8b4e-f32f2283b573 req-ed73fbf9-ea31-42ff-8d1c-4d8121b40665 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:43.564917 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-b30f6e6a-cab5-4aca-8b4e-f32f2283b573 req-ed73fbf9-ea31-42ff-8d1c-4d8121b40665 service nova] Creating event network-changed:97f1a3f8-15d4-41fb-82b2-8ab9cec6e359 for instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 on hv-cinder-84496 Sep 14 12:08:43.569210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-b30f6e6a-cab5-4aca-8b4e-f32f2283b573 req-ed73fbf9-ea31-42ff-8d1c-4d8121b40665 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040339 Sep 14 12:08:43.569815 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 194/367] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:08:43.636538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4101b630-28d7-4346-8467-1f6c1cbe2095 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:43.637136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4101b630-28d7-4346-8467-1f6c1cbe2095 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:43.643793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4101b630-28d7-4346-8467-1f6c1cbe2095 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:43.644289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4101b630-28d7-4346-8467-1f6c1cbe2095 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:43.644726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4101b630-28d7-4346-8467-1f6c1cbe2095 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:43.645430 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4101b630-28d7-4346-8467-1f6c1cbe2095 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:43.645908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4101b630-28d7-4346-8467-1f6c1cbe2095 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:43.646337 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4101b630-28d7-4346-8467-1f6c1cbe2095 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:43.724211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-baca1e28-e885-4705-aa20-fcaf419773b3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:43.725020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-baca1e28-e885-4705-aa20-fcaf419773b3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:43.731813 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baca1e28-e885-4705-aa20-fcaf419773b3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:43.732418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baca1e28-e885-4705-aa20-fcaf419773b3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:43.732957 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baca1e28-e885-4705-aa20-fcaf419773b3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:43.733775 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baca1e28-e885-4705-aa20-fcaf419773b3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:43.734402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baca1e28-e885-4705-aa20-fcaf419773b3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:43.734954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-baca1e28-e885-4705-aa20-fcaf419773b3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:43.814219 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4101b630-28d7-4346-8467-1f6c1cbe2095 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:43.822421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4101b630-28d7-4346-8467-1f6c1cbe2095 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.189648 Sep 14 12:08:43.823599 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 174/368] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:43 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:43.897630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-baca1e28-e885-4705-aa20-fcaf419773b3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:43.906600 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-baca1e28-e885-4705-aa20-fcaf419773b3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.186899 Sep 14 12:08:43.907176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 195/369] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:43 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:44.275770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-25e4aa4a-decc-449d-ab4b-28dcbdfc7c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:44.276325 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-25e4aa4a-decc-449d-ab4b-28dcbdfc7c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:44.283075 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-25e4aa4a-decc-449d-ab4b-28dcbdfc7c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:44.284165 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-25e4aa4a-decc-449d-ab4b-28dcbdfc7c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:44.284165 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-25e4aa4a-decc-449d-ab4b-28dcbdfc7c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:44.284925 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-25e4aa4a-decc-449d-ab4b-28dcbdfc7c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:44.285450 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-25e4aa4a-decc-449d-ab4b-28dcbdfc7c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:44.286055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-25e4aa4a-decc-449d-ab4b-28dcbdfc7c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:44.353485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-25e4aa4a-decc-449d-ab4b-28dcbdfc7c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:44.362142 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-25e4aa4a-decc-449d-ab4b-28dcbdfc7c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1222 microversion: 2.1 time: 0.091367 Sep 14 12:08:44.362738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 175/370] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:44 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:44.848375 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-37f0a190-0787-4b94-9432-836b290a4162 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:44.848972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-37f0a190-0787-4b94-9432-836b290a4162 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:44.855007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37f0a190-0787-4b94-9432-836b290a4162 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:44.855490 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37f0a190-0787-4b94-9432-836b290a4162 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:44.855920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37f0a190-0787-4b94-9432-836b290a4162 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:44.856617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37f0a190-0787-4b94-9432-836b290a4162 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:44.857054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37f0a190-0787-4b94-9432-836b290a4162 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:44.857476 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37f0a190-0787-4b94-9432-836b290a4162 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:44.929148 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ac475753-c1bb-49c1-8236-5fc0c922f0b8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:44.929914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ac475753-c1bb-49c1-8236-5fc0c922f0b8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:44.937654 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac475753-c1bb-49c1-8236-5fc0c922f0b8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:44.938189 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac475753-c1bb-49c1-8236-5fc0c922f0b8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:44.938616 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac475753-c1bb-49c1-8236-5fc0c922f0b8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:44.939319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac475753-c1bb-49c1-8236-5fc0c922f0b8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:44.939804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac475753-c1bb-49c1-8236-5fc0c922f0b8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:44.940376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac475753-c1bb-49c1-8236-5fc0c922f0b8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:45.007440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-37f0a190-0787-4b94-9432-836b290a4162 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:45.022267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-37f0a190-0787-4b94-9432-836b290a4162 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.173852 Sep 14 12:08:45.022267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 196/371] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:44 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:45.095484 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ac475753-c1bb-49c1-8236-5fc0c922f0b8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:45.103295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ac475753-c1bb-49c1-8236-5fc0c922f0b8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.178028 Sep 14 12:08:45.103881 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 176/372] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:44 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:45.386341 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6a54659e-1e37-42b1-8915-74b632f24247 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:45.386955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6a54659e-1e37-42b1-8915-74b632f24247 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:45.393098 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a54659e-1e37-42b1-8915-74b632f24247 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:45.393597 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a54659e-1e37-42b1-8915-74b632f24247 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:45.394079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a54659e-1e37-42b1-8915-74b632f24247 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:45.394782 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a54659e-1e37-42b1-8915-74b632f24247 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:45.395245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a54659e-1e37-42b1-8915-74b632f24247 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:45.395668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a54659e-1e37-42b1-8915-74b632f24247 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:45.460818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6a54659e-1e37-42b1-8915-74b632f24247 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:45.469725 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6a54659e-1e37-42b1-8915-74b632f24247 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1222 microversion: 2.1 time: 0.087263 Sep 14 12:08:45.470333 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 197/373] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:45 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:46.041058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-95fae9b6-ab99-477b-b2a8-881b513e41b7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:46.041668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-95fae9b6-ab99-477b-b2a8-881b513e41b7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:46.048437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95fae9b6-ab99-477b-b2a8-881b513e41b7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:46.049123 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95fae9b6-ab99-477b-b2a8-881b513e41b7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:46.049567 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95fae9b6-ab99-477b-b2a8-881b513e41b7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:46.050292 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95fae9b6-ab99-477b-b2a8-881b513e41b7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:46.050748 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95fae9b6-ab99-477b-b2a8-881b513e41b7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:46.051213 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95fae9b6-ab99-477b-b2a8-881b513e41b7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:46.128774 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cbfd968a-e299-48c7-93d4-cd33b88f1b47 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:46.130428 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cbfd968a-e299-48c7-93d4-cd33b88f1b47 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:46.136356 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbfd968a-e299-48c7-93d4-cd33b88f1b47 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:46.136851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbfd968a-e299-48c7-93d4-cd33b88f1b47 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:46.137288 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbfd968a-e299-48c7-93d4-cd33b88f1b47 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:46.138025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbfd968a-e299-48c7-93d4-cd33b88f1b47 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:46.138566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbfd968a-e299-48c7-93d4-cd33b88f1b47 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:46.138991 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbfd968a-e299-48c7-93d4-cd33b88f1b47 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:46.200073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-95fae9b6-ab99-477b-b2a8-881b513e41b7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:46.209350 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-95fae9b6-ab99-477b-b2a8-881b513e41b7 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.172082 Sep 14 12:08:46.210868 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 177/374] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:46 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:46.315609 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cbfd968a-e299-48c7-93d4-cd33b88f1b47 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:46.323578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cbfd968a-e299-48c7-93d4-cd33b88f1b47 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.200686 Sep 14 12:08:46.324144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 198/375] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:46 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:46.497305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0dc065fe-f42d-4fc9-bb5b-4111d419b0ee tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:46.501265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0dc065fe-f42d-4fc9-bb5b-4111d419b0ee tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:46.505790 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dc065fe-f42d-4fc9-bb5b-4111d419b0ee tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:46.506340 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dc065fe-f42d-4fc9-bb5b-4111d419b0ee tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:46.506785 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dc065fe-f42d-4fc9-bb5b-4111d419b0ee tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:46.507523 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dc065fe-f42d-4fc9-bb5b-4111d419b0ee tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:46.508720 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dc065fe-f42d-4fc9-bb5b-4111d419b0ee tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:46.508720 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0dc065fe-f42d-4fc9-bb5b-4111d419b0ee tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:46.578965 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0dc065fe-f42d-4fc9-bb5b-4111d419b0ee tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:46.587670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0dc065fe-f42d-4fc9-bb5b-4111d419b0ee tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1222 microversion: 2.1 time: 0.098702 Sep 14 12:08:46.600726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 178/376] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:46 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:47.234055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c6bfdf77-95a3-4bac-ae1a-861b87a379a6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:47.234672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c6bfdf77-95a3-4bac-ae1a-861b87a379a6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:47.241318 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6bfdf77-95a3-4bac-ae1a-861b87a379a6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:47.241824 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6bfdf77-95a3-4bac-ae1a-861b87a379a6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:47.242347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6bfdf77-95a3-4bac-ae1a-861b87a379a6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:47.243050 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6bfdf77-95a3-4bac-ae1a-861b87a379a6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:47.243531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6bfdf77-95a3-4bac-ae1a-861b87a379a6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:47.243934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6bfdf77-95a3-4bac-ae1a-861b87a379a6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:47.249157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:47.349433 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5243643c-fbbe-41b0-afbc-79202e748db0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:47.350101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5243643c-fbbe-41b0-afbc-79202e748db0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:47.356796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5243643c-fbbe-41b0-afbc-79202e748db0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:47.357303 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5243643c-fbbe-41b0-afbc-79202e748db0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:47.357745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5243643c-fbbe-41b0-afbc-79202e748db0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:47.359038 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5243643c-fbbe-41b0-afbc-79202e748db0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:47.359753 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5243643c-fbbe-41b0-afbc-79202e748db0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:47.360129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5243643c-fbbe-41b0-afbc-79202e748db0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:47.402061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c6bfdf77-95a3-4bac-ae1a-861b87a379a6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:47.402061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c6bfdf77-95a3-4bac-ae1a-861b87a379a6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.169406 Sep 14 12:08:47.410226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 199/377] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:47 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:47.504482 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5243643c-fbbe-41b0-afbc-79202e748db0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:47.512158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5243643c-fbbe-41b0-afbc-79202e748db0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.168022 Sep 14 12:08:47.512726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 179/378] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:47 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:47.618582 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-685f6397-68e6-4926-be7c-70797323dcf5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:47.619258 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-685f6397-68e6-4926-be7c-70797323dcf5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:47.626435 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-685f6397-68e6-4926-be7c-70797323dcf5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:47.626927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-685f6397-68e6-4926-be7c-70797323dcf5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:47.627365 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-685f6397-68e6-4926-be7c-70797323dcf5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:47.628275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-685f6397-68e6-4926-be7c-70797323dcf5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:47.628638 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-685f6397-68e6-4926-be7c-70797323dcf5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:47.629062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-685f6397-68e6-4926-be7c-70797323dcf5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:47.697713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-685f6397-68e6-4926-be7c-70797323dcf5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:47.705460 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-685f6397-68e6-4926-be7c-70797323dcf5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1270 microversion: 2.1 time: 0.090639 Sep 14 12:08:47.706076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 200/379] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:47 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:48.423296 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-63582c68-9d0b-487d-9713-6246ea26acdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:48.423909 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-63582c68-9d0b-487d-9713-6246ea26acdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:48.431515 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63582c68-9d0b-487d-9713-6246ea26acdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:48.432409 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63582c68-9d0b-487d-9713-6246ea26acdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:48.432834 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63582c68-9d0b-487d-9713-6246ea26acdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:48.433559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63582c68-9d0b-487d-9713-6246ea26acdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:48.434049 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63582c68-9d0b-487d-9713-6246ea26acdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:48.434482 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63582c68-9d0b-487d-9713-6246ea26acdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:48.535331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0b9c8a8c-0ee3-4c36-9bef-1b54b8e28015 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:48.536026 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0b9c8a8c-0ee3-4c36-9bef-1b54b8e28015 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:48.542420 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b9c8a8c-0ee3-4c36-9bef-1b54b8e28015 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:48.542905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b9c8a8c-0ee3-4c36-9bef-1b54b8e28015 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:48.543340 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b9c8a8c-0ee3-4c36-9bef-1b54b8e28015 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:48.544034 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b9c8a8c-0ee3-4c36-9bef-1b54b8e28015 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:48.544542 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b9c8a8c-0ee3-4c36-9bef-1b54b8e28015 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:48.544902 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b9c8a8c-0ee3-4c36-9bef-1b54b8e28015 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:48.568543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-63582c68-9d0b-487d-9713-6246ea26acdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:48.578214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-63582c68-9d0b-487d-9713-6246ea26acdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.158653 Sep 14 12:08:48.578817 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 180/380] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:48 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:48.683267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0b9c8a8c-0ee3-4c36-9bef-1b54b8e28015 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:48.692039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0b9c8a8c-0ee3-4c36-9bef-1b54b8e28015 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.160471 Sep 14 12:08:48.692676 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 201/381] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:48 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:48.729452 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c5bbd87b-c537-4bad-9ccd-7ca896d7fe88 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:48.730091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c5bbd87b-c537-4bad-9ccd-7ca896d7fe88 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:48.735991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5bbd87b-c537-4bad-9ccd-7ca896d7fe88 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:48.736478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5bbd87b-c537-4bad-9ccd-7ca896d7fe88 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:48.736915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5bbd87b-c537-4bad-9ccd-7ca896d7fe88 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:48.737597 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5bbd87b-c537-4bad-9ccd-7ca896d7fe88 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:48.738090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5bbd87b-c537-4bad-9ccd-7ca896d7fe88 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:48.738508 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5bbd87b-c537-4bad-9ccd-7ca896d7fe88 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:48.742592 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:48.806296 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c5bbd87b-c537-4bad-9ccd-7ca896d7fe88 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:48.824704 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c5bbd87b-c537-4bad-9ccd-7ca896d7fe88 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1270 microversion: 2.1 time: 0.098941 Sep 14 12:08:48.825226 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 181/382] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:48 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:49.601536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3312b41e-7219-4b7a-b643-24ecb2b3815b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:49.602181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3312b41e-7219-4b7a-b643-24ecb2b3815b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:49.608687 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3312b41e-7219-4b7a-b643-24ecb2b3815b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:49.609175 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3312b41e-7219-4b7a-b643-24ecb2b3815b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:49.609672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3312b41e-7219-4b7a-b643-24ecb2b3815b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:49.610425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3312b41e-7219-4b7a-b643-24ecb2b3815b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:49.610871 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3312b41e-7219-4b7a-b643-24ecb2b3815b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:49.611292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3312b41e-7219-4b7a-b643-24ecb2b3815b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:49.715786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6edfd24d-b511-4cd5-a8c5-168a07aeac5a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:49.716365 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6edfd24d-b511-4cd5-a8c5-168a07aeac5a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:49.729527 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6edfd24d-b511-4cd5-a8c5-168a07aeac5a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:49.730066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6edfd24d-b511-4cd5-a8c5-168a07aeac5a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:49.730504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6edfd24d-b511-4cd5-a8c5-168a07aeac5a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:49.731220 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6edfd24d-b511-4cd5-a8c5-168a07aeac5a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:49.731674 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6edfd24d-b511-4cd5-a8c5-168a07aeac5a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:49.732101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6edfd24d-b511-4cd5-a8c5-168a07aeac5a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:49.945566 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6edfd24d-b511-4cd5-a8c5-168a07aeac5a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:49.948451 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3312b41e-7219-4b7a-b643-24ecb2b3815b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:49.954994 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6edfd24d-b511-4cd5-a8c5-168a07aeac5a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.243135 Sep 14 12:08:49.955579 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 182/383] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:49 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:49.957159 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3312b41e-7219-4b7a-b643-24ecb2b3815b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.359512 Sep 14 12:08:49.957715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 202/384] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:49 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:49.960564 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-66bc1ef6-f384-471d-b979-8056be9b8cfd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:49.961462 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-66bc1ef6-f384-471d-b979-8056be9b8cfd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:49.968369 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66bc1ef6-f384-471d-b979-8056be9b8cfd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:49.968952 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66bc1ef6-f384-471d-b979-8056be9b8cfd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:49.969395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66bc1ef6-f384-471d-b979-8056be9b8cfd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:49.970125 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66bc1ef6-f384-471d-b979-8056be9b8cfd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:49.970586 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66bc1ef6-f384-471d-b979-8056be9b8cfd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:49.971081 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-66bc1ef6-f384-471d-b979-8056be9b8cfd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:50.039115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-66bc1ef6-f384-471d-b979-8056be9b8cfd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:50.047020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-66bc1ef6-f384-471d-b979-8056be9b8cfd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1270 microversion: 2.1 time: 0.090262 Sep 14 12:08:50.047598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 183/385] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:49 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:50.980989 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-82c22802-8e0b-4121-a487-9f6eec4c3de4 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:50.981727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-82c22802-8e0b-4121-a487-9f6eec4c3de4 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:50.983958 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d90f7977-7728-4dd5-b682-2b4b792221fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:50.985197 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d90f7977-7728-4dd5-b682-2b4b792221fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:50.987551 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:50.989031 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-82c22802-8e0b-4121-a487-9f6eec4c3de4 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:50.991133 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-82c22802-8e0b-4121-a487-9f6eec4c3de4 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:50.992008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-82c22802-8e0b-4121-a487-9f6eec4c3de4 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:50.992844 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-82c22802-8e0b-4121-a487-9f6eec4c3de4 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:50.993016 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90f7977-7728-4dd5-b682-2b4b792221fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:50.993331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-82c22802-8e0b-4121-a487-9f6eec4c3de4 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:50.993527 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90f7977-7728-4dd5-b682-2b4b792221fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:50.993792 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-82c22802-8e0b-4121-a487-9f6eec4c3de4 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:50.993985 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90f7977-7728-4dd5-b682-2b4b792221fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:50.994558 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90f7977-7728-4dd5-b682-2b4b792221fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:50.995048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90f7977-7728-4dd5-b682-2b4b792221fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:50.995516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d90f7977-7728-4dd5-b682-2b4b792221fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:51.028454 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=8 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:51.190205 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-82c22802-8e0b-4121-a487-9f6eec4c3de4 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:51.196850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d90f7977-7728-4dd5-b682-2b4b792221fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:51.201742 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-82c22802-8e0b-4121-a487-9f6eec4c3de4 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.224768 Sep 14 12:08:51.202374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 203/386] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:50 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:51.206147 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d90f7977-7728-4dd5-b682-2b4b792221fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.226175 Sep 14 12:08:51.207090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 184/387] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:50 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:51.207363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9a356d70-694d-4868-97cd-7af3d3983e32 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:51.207968 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9a356d70-694d-4868-97cd-7af3d3983e32 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:51.213979 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a356d70-694d-4868-97cd-7af3d3983e32 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:51.214460 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a356d70-694d-4868-97cd-7af3d3983e32 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:51.214892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a356d70-694d-4868-97cd-7af3d3983e32 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:51.215634 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a356d70-694d-4868-97cd-7af3d3983e32 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:51.216028 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a356d70-694d-4868-97cd-7af3d3983e32 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:51.216448 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a356d70-694d-4868-97cd-7af3d3983e32 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:51.278061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9a356d70-694d-4868-97cd-7af3d3983e32 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:51.286294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9a356d70-694d-4868-97cd-7af3d3983e32 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1270 microversion: 2.1 time: 0.082939 Sep 14 12:08:51.286855 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 204/388] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:51 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:52.228918 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-841c1e4b-3417-40be-a980-e2875b5835bb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:52.229548 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-841c1e4b-3417-40be-a980-e2875b5835bb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:52.231196 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1345e773-6ed5-45e6-b2b9-213137f40f73 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:52.231880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1345e773-6ed5-45e6-b2b9-213137f40f73 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:52.233875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:52.236052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841c1e4b-3417-40be-a980-e2875b5835bb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:52.236544 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841c1e4b-3417-40be-a980-e2875b5835bb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:52.236982 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841c1e4b-3417-40be-a980-e2875b5835bb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:52.237699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841c1e4b-3417-40be-a980-e2875b5835bb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:52.238167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841c1e4b-3417-40be-a980-e2875b5835bb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:52.238591 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-841c1e4b-3417-40be-a980-e2875b5835bb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:52.238884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1345e773-6ed5-45e6-b2b9-213137f40f73 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:52.239472 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1345e773-6ed5-45e6-b2b9-213137f40f73 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:52.240114 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1345e773-6ed5-45e6-b2b9-213137f40f73 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:52.240814 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1345e773-6ed5-45e6-b2b9-213137f40f73 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:52.241267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1345e773-6ed5-45e6-b2b9-213137f40f73 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:52.241689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1345e773-6ed5-45e6-b2b9-213137f40f73 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:52.438488 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-841c1e4b-3417-40be-a980-e2875b5835bb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:52.442766 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1345e773-6ed5-45e6-b2b9-213137f40f73 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:52.446884 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-841c1e4b-3417-40be-a980-e2875b5835bb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.222069 Sep 14 12:08:52.447544 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 185/389] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:52 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:52.465090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1345e773-6ed5-45e6-b2b9-213137f40f73 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.225025 Sep 14 12:08:52.465090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 205/390] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:52 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:52.465339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7678849e-fdb2-4698-b337-3e76dc820e8f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:52.465339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7678849e-fdb2-4698-b337-3e76dc820e8f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:52.465339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7678849e-fdb2-4698-b337-3e76dc820e8f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:52.465339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7678849e-fdb2-4698-b337-3e76dc820e8f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:52.465628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7678849e-fdb2-4698-b337-3e76dc820e8f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:52.465628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7678849e-fdb2-4698-b337-3e76dc820e8f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:52.465628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7678849e-fdb2-4698-b337-3e76dc820e8f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:52.465628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7678849e-fdb2-4698-b337-3e76dc820e8f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:52.527542 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7678849e-fdb2-4698-b337-3e76dc820e8f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:52.535806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7678849e-fdb2-4698-b337-3e76dc820e8f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1270 microversion: 2.1 time: 0.087189 Sep 14 12:08:52.536377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 186/391] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:52 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:53.472520 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6a02ace7-f943-48c6-b679-bd5862525769 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:53.473132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6a02ace7-f943-48c6-b679-bd5862525769 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:53.480774 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a02ace7-f943-48c6-b679-bd5862525769 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:53.481265 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a02ace7-f943-48c6-b679-bd5862525769 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:53.481702 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a02ace7-f943-48c6-b679-bd5862525769 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:53.482472 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a02ace7-f943-48c6-b679-bd5862525769 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:53.482928 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a02ace7-f943-48c6-b679-bd5862525769 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:53.483355 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6a02ace7-f943-48c6-b679-bd5862525769 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:53.491775 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4e4ecba4-0bc8-487c-bc12-0bab9cbfb87c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:53.492492 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4e4ecba4-0bc8-487c-bc12-0bab9cbfb87c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:53.499289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e4ecba4-0bc8-487c-bc12-0bab9cbfb87c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:53.499789 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e4ecba4-0bc8-487c-bc12-0bab9cbfb87c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:53.500961 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e4ecba4-0bc8-487c-bc12-0bab9cbfb87c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:53.501737 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e4ecba4-0bc8-487c-bc12-0bab9cbfb87c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:53.502236 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e4ecba4-0bc8-487c-bc12-0bab9cbfb87c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:53.502797 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e4ecba4-0bc8-487c-bc12-0bab9cbfb87c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:53.700324 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6a02ace7-f943-48c6-b679-bd5862525769 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:53.704078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4e4ecba4-0bc8-487c-bc12-0bab9cbfb87c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:53.712909 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4e4ecba4-0bc8-487c-bc12-0bab9cbfb87c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.229029 Sep 14 12:08:53.713225 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6a02ace7-f943-48c6-b679-bd5862525769 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.244495 Sep 14 12:08:53.713958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 206/392] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:53 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:53.722039 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 187/393] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:53 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:53.726143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f0636226-9f1f-41bf-8e2e-9647524abb02 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:53.726651 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f0636226-9f1f-41bf-8e2e-9647524abb02 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:53.733156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0636226-9f1f-41bf-8e2e-9647524abb02 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:53.733644 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0636226-9f1f-41bf-8e2e-9647524abb02 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:53.734113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0636226-9f1f-41bf-8e2e-9647524abb02 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:53.735369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0636226-9f1f-41bf-8e2e-9647524abb02 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:53.735821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0636226-9f1f-41bf-8e2e-9647524abb02 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:53.736241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0636226-9f1f-41bf-8e2e-9647524abb02 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:53.802675 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f0636226-9f1f-41bf-8e2e-9647524abb02 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:53.811032 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f0636226-9f1f-41bf-8e2e-9647524abb02 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1270 microversion: 2.1 time: 0.095777 Sep 14 12:08:53.811613 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 207/394] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:53 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:54.238548 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-bf79e066-0d46-4c93-97fd-75d34fb59011 req-6021e4a7-648d-48ee-b5a5-1c269f821b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db89dc1f-418a-4442-835d-d99bf7ccba9e", "name": "network-vif-plugged", "status": "completed", "tag": "6ebf8114-6c7f-4cff-8ace-8be1c4341b8b"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:54.259489 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-bf79e066-0d46-4c93-97fd-75d34fb59011 req-6021e4a7-648d-48ee-b5a5-1c269f821b51 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:54.259876 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-bf79e066-0d46-4c93-97fd-75d34fb59011 req-6021e4a7-648d-48ee-b5a5-1c269f821b51 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:54.260336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-bf79e066-0d46-4c93-97fd-75d34fb59011 req-6021e4a7-648d-48ee-b5a5-1c269f821b51 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:54.273479 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-bf79e066-0d46-4c93-97fd-75d34fb59011 req-6021e4a7-648d-48ee-b5a5-1c269f821b51 service nova] Creating event network-vif-plugged:6ebf8114-6c7f-4cff-8ace-8be1c4341b8b for instance db89dc1f-418a-4442-835d-d99bf7ccba9e on hv-cinder-84496 Sep 14 12:08:54.279075 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-bf79e066-0d46-4c93-97fd-75d34fb59011 req-6021e4a7-648d-48ee-b5a5-1c269f821b51 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044728 Sep 14 12:08:54.279693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 188/395] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:08:54.737321 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d3e1ec9d-5a33-4501-ad3f-483f65745c54 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:54.737828 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ebfa739b-18dd-43d8-82e3-930a2ab367bc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:54.738682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ebfa739b-18dd-43d8-82e3-930a2ab367bc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:54.739057 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d3e1ec9d-5a33-4501-ad3f-483f65745c54 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:54.745588 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3e1ec9d-5a33-4501-ad3f-483f65745c54 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:54.746044 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebfa739b-18dd-43d8-82e3-930a2ab367bc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:54.746421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebfa739b-18dd-43d8-82e3-930a2ab367bc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:54.746748 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3e1ec9d-5a33-4501-ad3f-483f65745c54 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:54.747078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebfa739b-18dd-43d8-82e3-930a2ab367bc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:54.747248 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3e1ec9d-5a33-4501-ad3f-483f65745c54 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:54.747444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebfa739b-18dd-43d8-82e3-930a2ab367bc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:54.747880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3e1ec9d-5a33-4501-ad3f-483f65745c54 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:54.748226 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebfa739b-18dd-43d8-82e3-930a2ab367bc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:54.748484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3e1ec9d-5a33-4501-ad3f-483f65745c54 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:54.748806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebfa739b-18dd-43d8-82e3-930a2ab367bc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:54.749126 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3e1ec9d-5a33-4501-ad3f-483f65745c54 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:54.976896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d3e1ec9d-5a33-4501-ad3f-483f65745c54 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:54.983443 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ebfa739b-18dd-43d8-82e3-930a2ab367bc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:54.985499 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d3e1ec9d-5a33-4501-ad3f-483f65745c54 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.252285 Sep 14 12:08:54.986240 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 208/396] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:54 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:54.994787 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-27b0e3e1-5d4c-4dcc-8305-fddbd3cc8edb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:54.995917 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-27b0e3e1-5d4c-4dcc-8305-fddbd3cc8edb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:54.998090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ebfa739b-18dd-43d8-82e3-930a2ab367bc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.264792 Sep 14 12:08:54.999138 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 189/397] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:54 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:55.013496 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-27b0e3e1-5d4c-4dcc-8305-fddbd3cc8edb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:55.014436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-27b0e3e1-5d4c-4dcc-8305-fddbd3cc8edb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:55.015475 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-27b0e3e1-5d4c-4dcc-8305-fddbd3cc8edb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:55.016375 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-27b0e3e1-5d4c-4dcc-8305-fddbd3cc8edb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:55.016891 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-27b0e3e1-5d4c-4dcc-8305-fddbd3cc8edb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:55.017361 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-27b0e3e1-5d4c-4dcc-8305-fddbd3cc8edb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:55.087672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-27b0e3e1-5d4c-4dcc-8305-fddbd3cc8edb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:55.095752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-27b0e3e1-5d4c-4dcc-8305-fddbd3cc8edb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1270 microversion: 2.1 time: 0.108170 Sep 14 12:08:55.096559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 209/398] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:54 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:56.023808 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4e146784-1581-4336-9a1c-0b84a33f931d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:56.024830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5e2585e7-3809-4308-a5da-c90ff5d30a7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:56.025312 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4e146784-1581-4336-9a1c-0b84a33f931d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:56.025467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5e2585e7-3809-4308-a5da-c90ff5d30a7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:56.031781 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4e146784-1581-4336-9a1c-0b84a33f931d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:56.032133 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e2585e7-3809-4308-a5da-c90ff5d30a7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:56.032366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4e146784-1581-4336-9a1c-0b84a33f931d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:56.032993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e2585e7-3809-4308-a5da-c90ff5d30a7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:56.033164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4e146784-1581-4336-9a1c-0b84a33f931d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:56.033349 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e2585e7-3809-4308-a5da-c90ff5d30a7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:56.033500 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4e146784-1581-4336-9a1c-0b84a33f931d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:56.033769 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e2585e7-3809-4308-a5da-c90ff5d30a7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:56.033940 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4e146784-1581-4336-9a1c-0b84a33f931d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:56.034274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4e146784-1581-4336-9a1c-0b84a33f931d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:56.034425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e2585e7-3809-4308-a5da-c90ff5d30a7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:56.034766 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5e2585e7-3809-4308-a5da-c90ff5d30a7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:56.260557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4e146784-1581-4336-9a1c-0b84a33f931d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:56.261768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5e2585e7-3809-4308-a5da-c90ff5d30a7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:56.270376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5e2585e7-3809-4308-a5da-c90ff5d30a7d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.250457 Sep 14 12:08:56.281884 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 190/399] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:56 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:56.282074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4e146784-1581-4336-9a1c-0b84a33f931d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.254313 Sep 14 12:08:56.282074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 210/400] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:56 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:56.284496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6f3c85cc-fe3c-4da9-a2f2-690870179bbd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:56.284496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6f3c85cc-fe3c-4da9-a2f2-690870179bbd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:56.284496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f3c85cc-fe3c-4da9-a2f2-690870179bbd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:56.284496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f3c85cc-fe3c-4da9-a2f2-690870179bbd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:56.285011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f3c85cc-fe3c-4da9-a2f2-690870179bbd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:56.285011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f3c85cc-fe3c-4da9-a2f2-690870179bbd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:56.285475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f3c85cc-fe3c-4da9-a2f2-690870179bbd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:56.285934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f3c85cc-fe3c-4da9-a2f2-690870179bbd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:56.366803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6f3c85cc-fe3c-4da9-a2f2-690870179bbd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:56.379449 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6f3c85cc-fe3c-4da9-a2f2-690870179bbd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1270 microversion: 2.1 time: 0.106545 Sep 14 12:08:56.380316 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 191/401] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:56 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:57.298321 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-920abd8d-05a5-4527-9207-bb9f190e540c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:57.299120 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c25e07e4-fbb2-4b8c-a619-0ece8e224bdc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:57.299734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-920abd8d-05a5-4527-9207-bb9f190e540c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:57.299928 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c25e07e4-fbb2-4b8c-a619-0ece8e224bdc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:57.306234 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c25e07e4-fbb2-4b8c-a619-0ece8e224bdc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:57.306932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c25e07e4-fbb2-4b8c-a619-0ece8e224bdc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:57.307372 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c25e07e4-fbb2-4b8c-a619-0ece8e224bdc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:57.308084 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c25e07e4-fbb2-4b8c-a619-0ece8e224bdc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:57.308544 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c25e07e4-fbb2-4b8c-a619-0ece8e224bdc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:57.308972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c25e07e4-fbb2-4b8c-a619-0ece8e224bdc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:57.309178 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-920abd8d-05a5-4527-9207-bb9f190e540c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:57.310117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-920abd8d-05a5-4527-9207-bb9f190e540c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:57.310902 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-920abd8d-05a5-4527-9207-bb9f190e540c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:57.312140 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-920abd8d-05a5-4527-9207-bb9f190e540c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:57.312961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-920abd8d-05a5-4527-9207-bb9f190e540c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:57.313974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-920abd8d-05a5-4527-9207-bb9f190e540c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:57.515389 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c25e07e4-fbb2-4b8c-a619-0ece8e224bdc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:57.524055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-920abd8d-05a5-4527-9207-bb9f190e540c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:57.524755 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c25e07e4-fbb2-4b8c-a619-0ece8e224bdc tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.229386 Sep 14 12:08:57.525358 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 192/402] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:57 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:57.532297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ea3652f8-5917-4c00-94c7-7194f0937646 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:57.532892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-920abd8d-05a5-4527-9207-bb9f190e540c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.239916 Sep 14 12:08:57.533026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ea3652f8-5917-4c00-94c7-7194f0937646 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:57.533656 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 211/403] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:57 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:57.539746 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea3652f8-5917-4c00-94c7-7194f0937646 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:57.540568 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea3652f8-5917-4c00-94c7-7194f0937646 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:57.541068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea3652f8-5917-4c00-94c7-7194f0937646 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:57.541843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea3652f8-5917-4c00-94c7-7194f0937646 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:57.542328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea3652f8-5917-4c00-94c7-7194f0937646 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:57.542764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea3652f8-5917-4c00-94c7-7194f0937646 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:57.616854 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ea3652f8-5917-4c00-94c7-7194f0937646 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:57.626275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ea3652f8-5917-4c00-94c7-7194f0937646 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1270 microversion: 2.1 time: 0.097521 Sep 14 12:08:57.632384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 193/404] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:57 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:58.559218 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-576de86f-91f7-43fa-b765-eaccd043529f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:58.560142 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-576de86f-91f7-43fa-b765-eaccd043529f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:58.560844 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-aca6b3a4-3b73-4c5c-9728-2a7ade57cb80 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:58.562415 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-aca6b3a4-3b73-4c5c-9728-2a7ade57cb80 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:58.567814 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-576de86f-91f7-43fa-b765-eaccd043529f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:58.568402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-576de86f-91f7-43fa-b765-eaccd043529f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:58.568843 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-576de86f-91f7-43fa-b765-eaccd043529f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:58.569549 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-576de86f-91f7-43fa-b765-eaccd043529f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:58.570039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-576de86f-91f7-43fa-b765-eaccd043529f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:58.570469 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-576de86f-91f7-43fa-b765-eaccd043529f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:58.573234 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aca6b3a4-3b73-4c5c-9728-2a7ade57cb80 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:58.574113 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aca6b3a4-3b73-4c5c-9728-2a7ade57cb80 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:58.574882 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aca6b3a4-3b73-4c5c-9728-2a7ade57cb80 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:58.576086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aca6b3a4-3b73-4c5c-9728-2a7ade57cb80 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:58.576889 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aca6b3a4-3b73-4c5c-9728-2a7ade57cb80 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:58.577639 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aca6b3a4-3b73-4c5c-9728-2a7ade57cb80 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:58.781453 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-576de86f-91f7-43fa-b765-eaccd043529f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:58.786744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-aca6b3a4-3b73-4c5c-9728-2a7ade57cb80 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:58.793293 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-576de86f-91f7-43fa-b765-eaccd043529f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.240311 Sep 14 12:08:58.794353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 212/405] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:58 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:58.794704 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-aca6b3a4-3b73-4c5c-9728-2a7ade57cb80 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1502 microversion: 2.1 time: 0.240132 Sep 14 12:08:58.795487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 194/406] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:58 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:08:58.800694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b1e5fa2d-ae5c-441d-afc0-8e6adbd88076 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:58.801546 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b1e5fa2d-ae5c-441d-afc0-8e6adbd88076 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:58.810273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1e5fa2d-ae5c-441d-afc0-8e6adbd88076 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:58.811075 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1e5fa2d-ae5c-441d-afc0-8e6adbd88076 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:58.811731 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1e5fa2d-ae5c-441d-afc0-8e6adbd88076 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:58.812818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1e5fa2d-ae5c-441d-afc0-8e6adbd88076 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:58.813508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1e5fa2d-ae5c-441d-afc0-8e6adbd88076 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:58.814038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1e5fa2d-ae5c-441d-afc0-8e6adbd88076 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:58.817469 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc545730-cad8-497b-a2aa-9ba83be468dc"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:58.819974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:58.826022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:58.826500 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:58.826948 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:58.827662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:58.828123 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:58.829054 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:58.853215 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] HTTP exception thrown: Cannot 'attach_volume' instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 while it is in vm_state rescued Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Request method failure captured: Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: POST /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82/os-volume_attachments HTTP/1.1 Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 74 Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcO0QaCS6xXTzM6jpZKpig5OWwgN4DxcmFTi61vISCiYbIqj92GCFK2Ykao8lOPtpzCjwB5UFh2EALT9e-6aRP6sfCRAMRClNQTuYs6OK-1skVV-bbMgM1Rb_IgbUayTgQvhQjd_qmnAYRMCxoLQ6qRy3J7d-3d9WDsecW3_-xRcxwM Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 748b7c08460b4f718dfff67275d8e4e4 Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:08:58.855507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/748b7c08460b4f718dfff67275d8e4e4"}]}] Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 748b7c08460b4f718dfff67275d8e4e4 Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-ServerRescueNegativeTestJSON-761218752-project Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 4bd4125ff6bb400bae1b94df7d2cfa17 Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-ServerRescueNegativeTestJSON-761218752-project Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {"volumeAttachment": {"volumeId": "dc545730-cad8-497b-a2aa-9ba83be468dc"}} Sep 14 12:08:58.858029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Cannot 'attach_volume' instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 while it is in vm_state rescued Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'server_id': '7649ff4f-2137-402c-a210-b4b9f4c95b82', 'body': {'volumeAttachment': {'volumeId': 'dc545730-cad8-497b-a2aa-9ba83be468dc'}}} Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:08:58.859645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 while it is in vm_state rescued Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:08:58.861538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:08:58.863129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:08:58.863129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:08:58.863129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 while it is in vm_state rescued Sep 14 12:08:58.863129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:08:58.863129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Returning 409 to user: Cannot 'attach_volume' instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 while it is in vm_state rescued {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:08:58.863129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-47d73cd1-35a7-4b42-9115-c2d23fc546fe tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043436 Sep 14 12:08:58.863129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 195/407] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:08:58 2022] POST /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 14 12:08:58.866822 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9fd5b267-34d4-4f5c-a581-14a07a0cdda3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:08:58.866822 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9fd5b267-34d4-4f5c-a581-14a07a0cdda3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:58.872714 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fd5b267-34d4-4f5c-a581-14a07a0cdda3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:58.873201 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fd5b267-34d4-4f5c-a581-14a07a0cdda3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:58.873641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fd5b267-34d4-4f5c-a581-14a07a0cdda3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:58.874394 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fd5b267-34d4-4f5c-a581-14a07a0cdda3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:58.874859 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fd5b267-34d4-4f5c-a581-14a07a0cdda3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:58.875796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fd5b267-34d4-4f5c-a581-14a07a0cdda3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:58.894473 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b1e5fa2d-ae5c-441d-afc0-8e6adbd88076 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:58.908196 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b1e5fa2d-ae5c-441d-afc0-8e6adbd88076 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1278 microversion: 2.1 time: 0.112183 Sep 14 12:08:58.909146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 213/408] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:58 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:59.076349 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9fd5b267-34d4-4f5c-a581-14a07a0cdda3 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82/action" status: 202 len: 0 microversion: 2.1 time: 0.213738 Sep 14 12:08:59.077074 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 196/409] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:08:58 2022] POST /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 12:08:59.086654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1efa98e2-d08c-4a94-89e9-b6846f7aa78c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:59.087343 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1efa98e2-d08c-4a94-89e9-b6846f7aa78c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:59.093632 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1efa98e2-d08c-4a94-89e9-b6846f7aa78c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:59.094144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1efa98e2-d08c-4a94-89e9-b6846f7aa78c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:59.094579 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1efa98e2-d08c-4a94-89e9-b6846f7aa78c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:59.095264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1efa98e2-d08c-4a94-89e9-b6846f7aa78c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:59.095717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1efa98e2-d08c-4a94-89e9-b6846f7aa78c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:59.096143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1efa98e2-d08c-4a94-89e9-b6846f7aa78c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:59.241056 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1efa98e2-d08c-4a94-89e9-b6846f7aa78c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:08:59.255349 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1efa98e2-d08c-4a94-89e9-b6846f7aa78c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.172520 Sep 14 12:08:59.256341 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 214/410] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:59 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:08:59.823095 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ba7626ea-11d4-4494-b217-487b1da56bf0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:59.825420 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ba7626ea-11d4-4494-b217-487b1da56bf0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:59.833321 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba7626ea-11d4-4494-b217-487b1da56bf0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:59.833321 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba7626ea-11d4-4494-b217-487b1da56bf0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:59.833623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba7626ea-11d4-4494-b217-487b1da56bf0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:59.834683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba7626ea-11d4-4494-b217-487b1da56bf0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:59.835764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba7626ea-11d4-4494-b217-487b1da56bf0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:59.836363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba7626ea-11d4-4494-b217-487b1da56bf0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:59.944496 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-dd667ab3-8b3a-4ea8-b589-8fdcb7df1ffb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:08:59.945460 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-dd667ab3-8b3a-4ea8-b589-8fdcb7df1ffb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:08:59.957974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd667ab3-8b3a-4ea8-b589-8fdcb7df1ffb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:59.964601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd667ab3-8b3a-4ea8-b589-8fdcb7df1ffb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:59.964601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd667ab3-8b3a-4ea8-b589-8fdcb7df1ffb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:08:59.964601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd667ab3-8b3a-4ea8-b589-8fdcb7df1ffb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:08:59.964601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd667ab3-8b3a-4ea8-b589-8fdcb7df1ffb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:08:59.965316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dd667ab3-8b3a-4ea8-b589-8fdcb7df1ffb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:00.016343 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ba7626ea-11d4-4494-b217-487b1da56bf0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:00.019973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:00.025703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ba7626ea-11d4-4494-b217-487b1da56bf0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1314 microversion: 2.1 time: 0.207966 Sep 14 12:09:00.037657 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 197/411] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:59 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:00.061841 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-dd667ab3-8b3a-4ea8-b589-8fdcb7df1ffb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:00.066677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:00.071982 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-dd667ab3-8b3a-4ea8-b589-8fdcb7df1ffb tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1278 microversion: 2.1 time: 0.135438 Sep 14 12:09:00.072968 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 215/412] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:08:59 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:00.294874 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b60cab7b-74e7-4b2d-878e-2b1606b4dcdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:00.295481 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b60cab7b-74e7-4b2d-878e-2b1606b4dcdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:00.305568 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60cab7b-74e7-4b2d-878e-2b1606b4dcdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:00.306144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60cab7b-74e7-4b2d-878e-2b1606b4dcdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:00.306589 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60cab7b-74e7-4b2d-878e-2b1606b4dcdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:00.307307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60cab7b-74e7-4b2d-878e-2b1606b4dcdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:00.307758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60cab7b-74e7-4b2d-878e-2b1606b4dcdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:00.309046 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b60cab7b-74e7-4b2d-878e-2b1606b4dcdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:00.545433 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b60cab7b-74e7-4b2d-878e-2b1606b4dcdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:00.558650 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b60cab7b-74e7-4b2d-878e-2b1606b4dcdb tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.268122 Sep 14 12:09:00.574722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 198/413] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:00 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:01.061924 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b04430bd-30c9-4bf0-818e-733ac63e9e2b tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:01.063231 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b04430bd-30c9-4bf0-818e-733ac63e9e2b tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:01.070090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b04430bd-30c9-4bf0-818e-733ac63e9e2b tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:01.070637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b04430bd-30c9-4bf0-818e-733ac63e9e2b tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:01.071308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b04430bd-30c9-4bf0-818e-733ac63e9e2b tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:01.074054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b04430bd-30c9-4bf0-818e-733ac63e9e2b tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:01.074054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b04430bd-30c9-4bf0-818e-733ac63e9e2b tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:01.074054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b04430bd-30c9-4bf0-818e-733ac63e9e2b tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:01.101653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-055fbe07-16df-4e3e-bd6d-00e5e113fb2c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:01.102738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-055fbe07-16df-4e3e-bd6d-00e5e113fb2c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:01.114078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-055fbe07-16df-4e3e-bd6d-00e5e113fb2c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:01.114707 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-055fbe07-16df-4e3e-bd6d-00e5e113fb2c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:01.115433 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-055fbe07-16df-4e3e-bd6d-00e5e113fb2c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:01.116633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-055fbe07-16df-4e3e-bd6d-00e5e113fb2c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:01.117363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-055fbe07-16df-4e3e-bd6d-00e5e113fb2c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:01.118426 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-055fbe07-16df-4e3e-bd6d-00e5e113fb2c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:01.224506 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-055fbe07-16df-4e3e-bd6d-00e5e113fb2c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:01.243198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-055fbe07-16df-4e3e-bd6d-00e5e113fb2c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1278 microversion: 2.1 time: 0.148875 Sep 14 12:09:01.250337 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 199/414] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:01 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:01.273701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b04430bd-30c9-4bf0-818e-733ac63e9e2b tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:01.285083 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b04430bd-30c9-4bf0-818e-733ac63e9e2b tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1498 microversion: 2.1 time: 0.229984 Sep 14 12:09:01.286030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 216/415] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:01 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:01.584614 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2dea6748-962e-4e3b-bc5f-be694f1a58d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:01.585632 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2dea6748-962e-4e3b-bc5f-be694f1a58d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:01.592042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dea6748-962e-4e3b-bc5f-be694f1a58d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:01.592951 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dea6748-962e-4e3b-bc5f-be694f1a58d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:01.593417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dea6748-962e-4e3b-bc5f-be694f1a58d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:01.595041 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dea6748-962e-4e3b-bc5f-be694f1a58d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:01.595523 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dea6748-962e-4e3b-bc5f-be694f1a58d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:01.595952 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2dea6748-962e-4e3b-bc5f-be694f1a58d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:01.742504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2dea6748-962e-4e3b-bc5f-be694f1a58d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:01.750645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2dea6748-962e-4e3b-bc5f-be694f1a58d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.169793 Sep 14 12:09:01.751129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 200/416] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:01 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:02.267063 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4797f153-67e3-41e5-b519-65a67c4674b1 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:02.267679 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4797f153-67e3-41e5-b519-65a67c4674b1 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:02.273668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4797f153-67e3-41e5-b519-65a67c4674b1 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:02.274421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4797f153-67e3-41e5-b519-65a67c4674b1 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:02.274868 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4797f153-67e3-41e5-b519-65a67c4674b1 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:02.275558 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4797f153-67e3-41e5-b519-65a67c4674b1 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:02.276003 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4797f153-67e3-41e5-b519-65a67c4674b1 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:02.276423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4797f153-67e3-41e5-b519-65a67c4674b1 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:02.365552 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4797f153-67e3-41e5-b519-65a67c4674b1 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:02.390557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4797f153-67e3-41e5-b519-65a67c4674b1 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1276 microversion: 2.1 time: 0.127645 Sep 14 12:09:02.391295 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 217/417] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:02 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:02.775299 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ba85d15d-74f5-46ed-b04e-1880942a7223 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:02.775912 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ba85d15d-74f5-46ed-b04e-1880942a7223 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:02.784218 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba85d15d-74f5-46ed-b04e-1880942a7223 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:02.784725 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba85d15d-74f5-46ed-b04e-1880942a7223 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:02.785166 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba85d15d-74f5-46ed-b04e-1880942a7223 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:02.785955 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba85d15d-74f5-46ed-b04e-1880942a7223 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:02.786497 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba85d15d-74f5-46ed-b04e-1880942a7223 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:02.786997 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba85d15d-74f5-46ed-b04e-1880942a7223 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:03.123838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ba85d15d-74f5-46ed-b04e-1880942a7223 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:03.132745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ba85d15d-74f5-46ed-b04e-1880942a7223 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.362157 Sep 14 12:09:03.141837 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 201/418] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:02 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:03.273489 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2fa9aa03-cd71-4df9-a55f-788f925da878 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:03.274408 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2fa9aa03-cd71-4df9-a55f-788f925da878 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:03.282692 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fa9aa03-cd71-4df9-a55f-788f925da878 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:03.283704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fa9aa03-cd71-4df9-a55f-788f925da878 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:03.284263 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fa9aa03-cd71-4df9-a55f-788f925da878 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:03.285281 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fa9aa03-cd71-4df9-a55f-788f925da878 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:03.285898 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fa9aa03-cd71-4df9-a55f-788f925da878 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:03.286518 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fa9aa03-cd71-4df9-a55f-788f925da878 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:03.325036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2fa9aa03-cd71-4df9-a55f-788f925da878 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Going to try to terminate instance {{(pid=121152) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:09:03.421499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3bf800c1-9276-48dd-b365-d035c4f8045a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:03.423145 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3bf800c1-9276-48dd-b365-d035c4f8045a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:03.430735 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bf800c1-9276-48dd-b365-d035c4f8045a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:03.431298 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bf800c1-9276-48dd-b365-d035c4f8045a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:03.431813 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bf800c1-9276-48dd-b365-d035c4f8045a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:03.432717 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bf800c1-9276-48dd-b365-d035c4f8045a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:03.433354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bf800c1-9276-48dd-b365-d035c4f8045a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:03.434070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3bf800c1-9276-48dd-b365-d035c4f8045a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:03.753673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2fa9aa03-cd71-4df9-a55f-788f925da878 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "DELETE /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 204 len: 0 microversion: 2.1 time: 0.484508 Sep 14 12:09:03.754577 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 218/419] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:09:03 2022] DELETE /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 12:09:03.763626 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1cc87132-1052-48f3-96cb-0f98d9bd8809 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:03.764246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1cc87132-1052-48f3-96cb-0f98d9bd8809 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:03.771557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1cc87132-1052-48f3-96cb-0f98d9bd8809 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:03.772018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1cc87132-1052-48f3-96cb-0f98d9bd8809 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:03.772554 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1cc87132-1052-48f3-96cb-0f98d9bd8809 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:03.773252 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1cc87132-1052-48f3-96cb-0f98d9bd8809 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:03.773709 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1cc87132-1052-48f3-96cb-0f98d9bd8809 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:03.774425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1cc87132-1052-48f3-96cb-0f98d9bd8809 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:04.031077 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3bf800c1-9276-48dd-b365-d035c4f8045a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:04.042784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3bf800c1-9276-48dd-b365-d035c4f8045a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.629787 Sep 14 12:09:04.043674 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 202/420] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:03 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:04.101427 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1cc87132-1052-48f3-96cb-0f98d9bd8809 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:04.110507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1cc87132-1052-48f3-96cb-0f98d9bd8809 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1504 microversion: 2.1 time: 0.351339 Sep 14 12:09:04.111175 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 219/421] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:03 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:04.158068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4f0eba8b-23df-40d4-bf59-80f1e6a2680f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:04.158737 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4f0eba8b-23df-40d4-bf59-80f1e6a2680f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:04.161130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:04.167380 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f0eba8b-23df-40d4-bf59-80f1e6a2680f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:04.168086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f0eba8b-23df-40d4-bf59-80f1e6a2680f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:04.172434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f0eba8b-23df-40d4-bf59-80f1e6a2680f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:04.172434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f0eba8b-23df-40d4-bf59-80f1e6a2680f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:04.172434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f0eba8b-23df-40d4-bf59-80f1e6a2680f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:04.172434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f0eba8b-23df-40d4-bf59-80f1e6a2680f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:04.349604 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4f0eba8b-23df-40d4-bf59-80f1e6a2680f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:04.380975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4f0eba8b-23df-40d4-bf59-80f1e6a2680f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.208593 Sep 14 12:09:04.380975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 203/422] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:04 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:04.838115 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-52d984cf-92d0-46ce-b18e-4152f3b6ec5d req-a3567665-8ca7-4c32-8e6e-0fc4c39a54ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991ad790-ed34-4f78-9db4-91ad889c3c47", "tag": "de246217-d047-4d75-a069-3f9ac78fe2d2"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:04.850634 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-52d984cf-92d0-46ce-b18e-4152f3b6ec5d req-a3567665-8ca7-4c32-8e6e-0fc4c39a54ed service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:04.851695 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-52d984cf-92d0-46ce-b18e-4152f3b6ec5d req-a3567665-8ca7-4c32-8e6e-0fc4c39a54ed service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:04.852848 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-52d984cf-92d0-46ce-b18e-4152f3b6ec5d req-a3567665-8ca7-4c32-8e6e-0fc4c39a54ed service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:04.885002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-52d984cf-92d0-46ce-b18e-4152f3b6ec5d req-a3567665-8ca7-4c32-8e6e-0fc4c39a54ed service nova] Creating event network-changed:de246217-d047-4d75-a069-3f9ac78fe2d2 for instance 991ad790-ed34-4f78-9db4-91ad889c3c47 on hv-cinder-84496 Sep 14 12:09:04.905173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-52d984cf-92d0-46ce-b18e-4152f3b6ec5d req-a3567665-8ca7-4c32-8e6e-0fc4c39a54ed service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072701 Sep 14 12:09:04.908106 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 220/423] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:09:05.073352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fde83e2d-9327-4cf4-be6d-bb9e353c8971 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:05.074060 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fde83e2d-9327-4cf4-be6d-bb9e353c8971 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:05.082323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fde83e2d-9327-4cf4-be6d-bb9e353c8971 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:05.083036 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fde83e2d-9327-4cf4-be6d-bb9e353c8971 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:05.083685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fde83e2d-9327-4cf4-be6d-bb9e353c8971 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:05.084565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fde83e2d-9327-4cf4-be6d-bb9e353c8971 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:05.085010 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fde83e2d-9327-4cf4-be6d-bb9e353c8971 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:05.085668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fde83e2d-9327-4cf4-be6d-bb9e353c8971 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:05.135162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1c1c3c01-1f63-4988-94b3-aad50d07b1ee tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:05.135776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1c1c3c01-1f63-4988-94b3-aad50d07b1ee tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:05.142874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1c3c01-1f63-4988-94b3-aad50d07b1ee tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:05.143371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1c3c01-1f63-4988-94b3-aad50d07b1ee tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:05.143835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1c3c01-1f63-4988-94b3-aad50d07b1ee tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:05.144616 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1c3c01-1f63-4988-94b3-aad50d07b1ee tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:05.145076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1c3c01-1f63-4988-94b3-aad50d07b1ee tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:05.145519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1c1c3c01-1f63-4988-94b3-aad50d07b1ee tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:05.268527 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fde83e2d-9327-4cf4-be6d-bb9e353c8971 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:05.276809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fde83e2d-9327-4cf4-be6d-bb9e353c8971 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.208348 Sep 14 12:09:05.277446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 204/424] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:05 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:05.317399 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1c1c3c01-1f63-4988-94b3-aad50d07b1ee tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:05.325981 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1c1c3c01-1f63-4988-94b3-aad50d07b1ee tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1504 microversion: 2.1 time: 0.194970 Sep 14 12:09:05.326568 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 221/425] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:05 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:05.389210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0fa5788a-8146-445b-8e45-d613c76e9d83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:05.389749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0fa5788a-8146-445b-8e45-d613c76e9d83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:05.397101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa5788a-8146-445b-8e45-d613c76e9d83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:05.397594 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa5788a-8146-445b-8e45-d613c76e9d83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:05.398066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa5788a-8146-445b-8e45-d613c76e9d83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:05.398771 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa5788a-8146-445b-8e45-d613c76e9d83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:05.399523 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa5788a-8146-445b-8e45-d613c76e9d83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:05.401711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa5788a-8146-445b-8e45-d613c76e9d83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:05.559925 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0fa5788a-8146-445b-8e45-d613c76e9d83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:05.571208 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0fa5788a-8146-445b-8e45-d613c76e9d83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.186157 Sep 14 12:09:05.571878 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 205/426] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:05 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:06.304362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-164e10a2-863f-4d74-ab92-2123c33ca323 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:06.305040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-164e10a2-863f-4d74-ab92-2123c33ca323 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:06.311100 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-164e10a2-863f-4d74-ab92-2123c33ca323 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:06.311613 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-164e10a2-863f-4d74-ab92-2123c33ca323 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:06.312045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-164e10a2-863f-4d74-ab92-2123c33ca323 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:06.313334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-164e10a2-863f-4d74-ab92-2123c33ca323 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:06.313791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-164e10a2-863f-4d74-ab92-2123c33ca323 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:06.314260 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-164e10a2-863f-4d74-ab92-2123c33ca323 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:06.349135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2785bb91-fefa-4883-8781-5ed0a1973b49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:06.349890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2785bb91-fefa-4883-8781-5ed0a1973b49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:06.356805 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2785bb91-fefa-4883-8781-5ed0a1973b49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:06.357297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2785bb91-fefa-4883-8781-5ed0a1973b49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:06.357962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2785bb91-fefa-4883-8781-5ed0a1973b49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:06.358695 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2785bb91-fefa-4883-8781-5ed0a1973b49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:06.359153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2785bb91-fefa-4883-8781-5ed0a1973b49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:06.360241 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2785bb91-fefa-4883-8781-5ed0a1973b49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:06.505852 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-164e10a2-863f-4d74-ab92-2123c33ca323 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:06.515006 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-164e10a2-863f-4d74-ab92-2123c33ca323 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.215443 Sep 14 12:09:06.516527 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 222/427] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:06 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:06.537417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2785bb91-fefa-4883-8781-5ed0a1973b49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:06.545299 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2785bb91-fefa-4883-8781-5ed0a1973b49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1504 microversion: 2.1 time: 0.200194 Sep 14 12:09:06.545899 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 206/428] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:06 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:06.595576 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5c23c43a-bc39-430f-9dee-989355c02928 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:06.596181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5c23c43a-bc39-430f-9dee-989355c02928 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:06.602440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c23c43a-bc39-430f-9dee-989355c02928 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:06.602936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c23c43a-bc39-430f-9dee-989355c02928 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:06.603370 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c23c43a-bc39-430f-9dee-989355c02928 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:06.604064 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c23c43a-bc39-430f-9dee-989355c02928 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:06.604515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c23c43a-bc39-430f-9dee-989355c02928 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:06.604980 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c23c43a-bc39-430f-9dee-989355c02928 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:06.754312 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5c23c43a-bc39-430f-9dee-989355c02928 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:06.762364 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5c23c43a-bc39-430f-9dee-989355c02928 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.171451 Sep 14 12:09:06.762969 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 223/429] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:06 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:07.538811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-31dce8d4-f38d-4721-bb47-d0a8bcd18749 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:07.539455 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-31dce8d4-f38d-4721-bb47-d0a8bcd18749 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:07.546408 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31dce8d4-f38d-4721-bb47-d0a8bcd18749 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:07.546949 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31dce8d4-f38d-4721-bb47-d0a8bcd18749 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:07.547404 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31dce8d4-f38d-4721-bb47-d0a8bcd18749 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:07.548144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31dce8d4-f38d-4721-bb47-d0a8bcd18749 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:07.548622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31dce8d4-f38d-4721-bb47-d0a8bcd18749 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:07.549091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31dce8d4-f38d-4721-bb47-d0a8bcd18749 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:07.569967 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-206e38ca-51b1-4122-acf9-2924619e9792 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:07.571029 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-206e38ca-51b1-4122-acf9-2924619e9792 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:07.579259 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-206e38ca-51b1-4122-acf9-2924619e9792 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:07.579861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-206e38ca-51b1-4122-acf9-2924619e9792 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:07.580305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-206e38ca-51b1-4122-acf9-2924619e9792 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:07.581008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-206e38ca-51b1-4122-acf9-2924619e9792 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:07.581480 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-206e38ca-51b1-4122-acf9-2924619e9792 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:07.581892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-206e38ca-51b1-4122-acf9-2924619e9792 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:07.755523 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-31dce8d4-f38d-4721-bb47-d0a8bcd18749 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:07.766997 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-31dce8d4-f38d-4721-bb47-d0a8bcd18749 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.232028 Sep 14 12:09:07.767600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 207/430] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:07 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:07.768704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-206e38ca-51b1-4122-acf9-2924619e9792 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:07.779325 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-206e38ca-51b1-4122-acf9-2924619e9792 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1504 microversion: 2.1 time: 0.212886 Sep 14 12:09:07.779325 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 224/431] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:07 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:07.792426 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a8233b9e-250b-49c2-9124-3bf1968ba035 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:07.793472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a8233b9e-250b-49c2-9124-3bf1968ba035 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:07.804683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8233b9e-250b-49c2-9124-3bf1968ba035 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:07.805722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8233b9e-250b-49c2-9124-3bf1968ba035 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:07.806401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8233b9e-250b-49c2-9124-3bf1968ba035 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:07.807694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8233b9e-250b-49c2-9124-3bf1968ba035 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:07.808534 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8233b9e-250b-49c2-9124-3bf1968ba035 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:07.809042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8233b9e-250b-49c2-9124-3bf1968ba035 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:07.967892 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a8233b9e-250b-49c2-9124-3bf1968ba035 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:07.981551 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a8233b9e-250b-49c2-9124-3bf1968ba035 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.196569 Sep 14 12:09:07.982608 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 208/432] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:07 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:08.790693 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-79b6eec5-05ba-434d-9fbb-dcd5b4664688 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:08.791285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-79b6eec5-05ba-434d-9fbb-dcd5b4664688 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:08.793315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:08.799634 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79b6eec5-05ba-434d-9fbb-dcd5b4664688 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:08.800177 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79b6eec5-05ba-434d-9fbb-dcd5b4664688 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:08.800621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79b6eec5-05ba-434d-9fbb-dcd5b4664688 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:08.801323 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79b6eec5-05ba-434d-9fbb-dcd5b4664688 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:08.801776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79b6eec5-05ba-434d-9fbb-dcd5b4664688 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:08.802255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79b6eec5-05ba-434d-9fbb-dcd5b4664688 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:08.816499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-38f9176c-fa5c-428a-befc-c4901deaa476 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:08.817206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-38f9176c-fa5c-428a-befc-c4901deaa476 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:08.824474 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38f9176c-fa5c-428a-befc-c4901deaa476 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:08.824950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38f9176c-fa5c-428a-befc-c4901deaa476 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:08.825382 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38f9176c-fa5c-428a-befc-c4901deaa476 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:08.826386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38f9176c-fa5c-428a-befc-c4901deaa476 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:08.826888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38f9176c-fa5c-428a-befc-c4901deaa476 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:08.827276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38f9176c-fa5c-428a-befc-c4901deaa476 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:09.017182 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-79b6eec5-05ba-434d-9fbb-dcd5b4664688 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:09.025450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-79b6eec5-05ba-434d-9fbb-dcd5b4664688 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.238681 Sep 14 12:09:09.030247 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 225/433] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:08 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:09.030768 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7296fbf8-2cdc-400d-92fa-21f06ef3ce24 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:09.032109 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7296fbf8-2cdc-400d-92fa-21f06ef3ce24 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:09.034297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-38f9176c-fa5c-428a-befc-c4901deaa476 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:09.038629 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7296fbf8-2cdc-400d-92fa-21f06ef3ce24 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:09.039121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7296fbf8-2cdc-400d-92fa-21f06ef3ce24 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:09.040071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7296fbf8-2cdc-400d-92fa-21f06ef3ce24 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:09.040292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7296fbf8-2cdc-400d-92fa-21f06ef3ce24 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:09.040767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7296fbf8-2cdc-400d-92fa-21f06ef3ce24 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:09.041395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7296fbf8-2cdc-400d-92fa-21f06ef3ce24 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:09.047033 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-38f9176c-fa5c-428a-befc-c4901deaa476 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1504 microversion: 2.1 time: 0.234255 Sep 14 12:09:09.047756 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 209/434] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:08 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:09.181381 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7296fbf8-2cdc-400d-92fa-21f06ef3ce24 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:09.193677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7296fbf8-2cdc-400d-92fa-21f06ef3ce24 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.166249 Sep 14 12:09:09.194733 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 226/435] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:09 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:10.055877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-48c50321-60bb-4fdb-9a23-00d1329cafac tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:10.056693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-48c50321-60bb-4fdb-9a23-00d1329cafac tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:10.065274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48c50321-60bb-4fdb-9a23-00d1329cafac tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:10.065775 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48c50321-60bb-4fdb-9a23-00d1329cafac tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:10.066368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48c50321-60bb-4fdb-9a23-00d1329cafac tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:10.067082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48c50321-60bb-4fdb-9a23-00d1329cafac tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:10.067538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48c50321-60bb-4fdb-9a23-00d1329cafac tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:10.067969 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48c50321-60bb-4fdb-9a23-00d1329cafac tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:10.070858 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b207ac88-75fc-400b-b598-530b7811c7e0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:10.071464 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b207ac88-75fc-400b-b598-530b7811c7e0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:10.077827 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b207ac88-75fc-400b-b598-530b7811c7e0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:10.078823 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b207ac88-75fc-400b-b598-530b7811c7e0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:10.079260 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b207ac88-75fc-400b-b598-530b7811c7e0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:10.079995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b207ac88-75fc-400b-b598-530b7811c7e0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:10.080442 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b207ac88-75fc-400b-b598-530b7811c7e0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:10.080875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b207ac88-75fc-400b-b598-530b7811c7e0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:10.271326 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-48c50321-60bb-4fdb-9a23-00d1329cafac tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:10.276024 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b207ac88-75fc-400b-b598-530b7811c7e0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:10.285105 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-48c50321-60bb-4fdb-9a23-00d1329cafac tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.234922 Sep 14 12:09:10.286100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 210/436] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:10 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:10.288463 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b207ac88-75fc-400b-b598-530b7811c7e0 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1504 microversion: 2.1 time: 0.221189 Sep 14 12:09:10.297999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 227/437] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:10 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:10.298181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b95c3c22-1f34-4937-b186-e231e9fd5c8a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:10.298181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b95c3c22-1f34-4937-b186-e231e9fd5c8a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:10.299284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b95c3c22-1f34-4937-b186-e231e9fd5c8a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:10.299779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b95c3c22-1f34-4937-b186-e231e9fd5c8a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:10.300269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b95c3c22-1f34-4937-b186-e231e9fd5c8a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:10.300915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b95c3c22-1f34-4937-b186-e231e9fd5c8a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:10.301372 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b95c3c22-1f34-4937-b186-e231e9fd5c8a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:10.301795 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b95c3c22-1f34-4937-b186-e231e9fd5c8a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:10.434185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b95c3c22-1f34-4937-b186-e231e9fd5c8a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:10.442585 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b95c3c22-1f34-4937-b186-e231e9fd5c8a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.155240 Sep 14 12:09:10.443167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 211/438] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:10 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:11.308172 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-da1b149a-4348-4e3e-9bf8-f00fcc58a611 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:11.308768 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-da1b149a-4348-4e3e-9bf8-f00fcc58a611 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:11.312553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cf53596b-5596-4f87-9427-6d98f5723797 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:11.313170 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cf53596b-5596-4f87-9427-6d98f5723797 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:11.317153 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-da1b149a-4348-4e3e-9bf8-f00fcc58a611 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:11.317653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-da1b149a-4348-4e3e-9bf8-f00fcc58a611 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:11.318444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-da1b149a-4348-4e3e-9bf8-f00fcc58a611 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:11.319297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-da1b149a-4348-4e3e-9bf8-f00fcc58a611 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:11.319751 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-da1b149a-4348-4e3e-9bf8-f00fcc58a611 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:11.320016 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf53596b-5596-4f87-9427-6d98f5723797 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:11.320195 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-da1b149a-4348-4e3e-9bf8-f00fcc58a611 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:11.320501 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf53596b-5596-4f87-9427-6d98f5723797 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:11.320941 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf53596b-5596-4f87-9427-6d98f5723797 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:11.321652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf53596b-5596-4f87-9427-6d98f5723797 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:11.322143 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf53596b-5596-4f87-9427-6d98f5723797 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:11.322933 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cf53596b-5596-4f87-9427-6d98f5723797 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:11.524743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cf53596b-5596-4f87-9427-6d98f5723797 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:11.527647 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-da1b149a-4348-4e3e-9bf8-f00fcc58a611 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:11.533973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cf53596b-5596-4f87-9427-6d98f5723797 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1504 microversion: 2.1 time: 0.225082 Sep 14 12:09:11.534275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 212/439] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:11 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:11.536964 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-da1b149a-4348-4e3e-9bf8-f00fcc58a611 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.232709 Sep 14 12:09:11.537712 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 228/440] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:11 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:11.539045 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-17e32b82-1bb6-4791-b488-655d279af4ee tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:11.539650 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-17e32b82-1bb6-4791-b488-655d279af4ee tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:11.546499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17e32b82-1bb6-4791-b488-655d279af4ee tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:11.551341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17e32b82-1bb6-4791-b488-655d279af4ee tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:11.551341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17e32b82-1bb6-4791-b488-655d279af4ee tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:11.551341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17e32b82-1bb6-4791-b488-655d279af4ee tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:11.551341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17e32b82-1bb6-4791-b488-655d279af4ee tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:11.551924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-17e32b82-1bb6-4791-b488-655d279af4ee tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:11.709353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-17e32b82-1bb6-4791-b488-655d279af4ee tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:11.722538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-17e32b82-1bb6-4791-b488-655d279af4ee tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.186842 Sep 14 12:09:11.723496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 213/441] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:11 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:12.560107 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a1592d5e-09e5-4bce-a35e-c791bca69f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:12.560719 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a1592d5e-09e5-4bce-a35e-c791bca69f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:12.563993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5d277b32-0f88-4a63-a45b-f8b4620ccbeb tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:12.565071 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5d277b32-0f88-4a63-a45b-f8b4620ccbeb tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:12.567148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a1592d5e-09e5-4bce-a35e-c791bca69f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:12.567636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a1592d5e-09e5-4bce-a35e-c791bca69f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:12.568071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a1592d5e-09e5-4bce-a35e-c791bca69f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:12.568776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a1592d5e-09e5-4bce-a35e-c791bca69f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:12.569224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a1592d5e-09e5-4bce-a35e-c791bca69f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:12.570109 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a1592d5e-09e5-4bce-a35e-c791bca69f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:12.575594 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d277b32-0f88-4a63-a45b-f8b4620ccbeb tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:12.576297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d277b32-0f88-4a63-a45b-f8b4620ccbeb tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:12.576741 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d277b32-0f88-4a63-a45b-f8b4620ccbeb tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:12.577707 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d277b32-0f88-4a63-a45b-f8b4620ccbeb tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:12.578196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d277b32-0f88-4a63-a45b-f8b4620ccbeb tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:12.578670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d277b32-0f88-4a63-a45b-f8b4620ccbeb tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:12.602014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:12.915793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a1592d5e-09e5-4bce-a35e-c791bca69f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:12.923766 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5d277b32-0f88-4a63-a45b-f8b4620ccbeb tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:12.933613 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a1592d5e-09e5-4bce-a35e-c791bca69f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.372604 Sep 14 12:09:12.933613 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 229/442] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:12 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:12.935022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-06b6ab38-d000-4907-93bc-6c37ad3ec059 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:12.935753 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-06b6ab38-d000-4907-93bc-6c37ad3ec059 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:12.942224 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5d277b32-0f88-4a63-a45b-f8b4620ccbeb tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1504 microversion: 2.1 time: 0.384117 Sep 14 12:09:12.943931 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b6ab38-d000-4907-93bc-6c37ad3ec059 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:12.944704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b6ab38-d000-4907-93bc-6c37ad3ec059 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:12.945485 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b6ab38-d000-4907-93bc-6c37ad3ec059 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:12.946599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b6ab38-d000-4907-93bc-6c37ad3ec059 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:12.947217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b6ab38-d000-4907-93bc-6c37ad3ec059 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:12.947803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b6ab38-d000-4907-93bc-6c37ad3ec059 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:12.954554 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 214/443] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:12 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:13.110102 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-06b6ab38-d000-4907-93bc-6c37ad3ec059 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:13.119063 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-06b6ab38-d000-4907-93bc-6c37ad3ec059 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1510 microversion: 2.1 time: 0.188222 Sep 14 12:09:13.119646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 230/444] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:12 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:13.956277 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0d1d86c4-9f79-44c1-b0a4-db2a1d219008 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:13.957175 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0d1d86c4-9f79-44c1-b0a4-db2a1d219008 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:13.965964 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d1d86c4-9f79-44c1-b0a4-db2a1d219008 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:13.966933 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d1d86c4-9f79-44c1-b0a4-db2a1d219008 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:13.967655 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d1d86c4-9f79-44c1-b0a4-db2a1d219008 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:13.968744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d1d86c4-9f79-44c1-b0a4-db2a1d219008 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:13.969970 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d1d86c4-9f79-44c1-b0a4-db2a1d219008 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:13.970641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d1d86c4-9f79-44c1-b0a4-db2a1d219008 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:13.972981 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e07bc5ca-6060-40f8-9d21-d6285ec265e1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:13.975592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e07bc5ca-6060-40f8-9d21-d6285ec265e1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:13.992445 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e07bc5ca-6060-40f8-9d21-d6285ec265e1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:13.993015 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e07bc5ca-6060-40f8-9d21-d6285ec265e1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:13.993450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e07bc5ca-6060-40f8-9d21-d6285ec265e1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:13.994513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e07bc5ca-6060-40f8-9d21-d6285ec265e1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:13.995143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e07bc5ca-6060-40f8-9d21-d6285ec265e1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:13.995743 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e07bc5ca-6060-40f8-9d21-d6285ec265e1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:14.018432 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:14.138786 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e07bc5ca-6060-40f8-9d21-d6285ec265e1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:14.162345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e07bc5ca-6060-40f8-9d21-d6285ec265e1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1462 microversion: 2.1 time: 0.198678 Sep 14 12:09:14.163788 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 231/445] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:13 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1462 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:14.170386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7dea24ea-6ffe-486d-ba08-35c3819e4b61 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:14.171495 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7dea24ea-6ffe-486d-ba08-35c3819e4b61 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:14.179346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7dea24ea-6ffe-486d-ba08-35c3819e4b61 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:14.180399 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7dea24ea-6ffe-486d-ba08-35c3819e4b61 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:14.181070 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7dea24ea-6ffe-486d-ba08-35c3819e4b61 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:14.182111 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7dea24ea-6ffe-486d-ba08-35c3819e4b61 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:14.182825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7dea24ea-6ffe-486d-ba08-35c3819e4b61 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:14.184550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7dea24ea-6ffe-486d-ba08-35c3819e4b61 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:14.358779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0d1d86c4-9f79-44c1-b0a4-db2a1d219008 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:14.369424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0d1d86c4-9f79-44c1-b0a4-db2a1d219008 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.417850 Sep 14 12:09:14.370334 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 215/446] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:13 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:14.383477 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-c4b6ce31-6840-450d-9be0-71ae1219c92a req-cddd1782-dbde-4cce-8573-14515835f815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db89dc1f-418a-4442-835d-d99bf7ccba9e", "name": "network-vif-deleted", "tag": "6ebf8114-6c7f-4cff-8ace-8be1c4341b8b"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:14.397417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-c4b6ce31-6840-450d-9be0-71ae1219c92a req-cddd1782-dbde-4cce-8573-14515835f815 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:14.397417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-c4b6ce31-6840-450d-9be0-71ae1219c92a req-cddd1782-dbde-4cce-8573-14515835f815 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:14.397417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-c4b6ce31-6840-450d-9be0-71ae1219c92a req-cddd1782-dbde-4cce-8573-14515835f815 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:14.410612 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-c4b6ce31-6840-450d-9be0-71ae1219c92a req-cddd1782-dbde-4cce-8573-14515835f815 service nova] Creating event network-vif-deleted:6ebf8114-6c7f-4cff-8ace-8be1c4341b8b for instance db89dc1f-418a-4442-835d-d99bf7ccba9e on hv-cinder-84496 Sep 14 12:09:14.419451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-c4b6ce31-6840-450d-9be0-71ae1219c92a req-cddd1782-dbde-4cce-8573-14515835f815 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047256 Sep 14 12:09:14.420190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 216/447] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:09:14.552912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7dea24ea-6ffe-486d-ba08-35c3819e4b61 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:14.562226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7dea24ea-6ffe-486d-ba08-35c3819e4b61 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1516 microversion: 2.1 time: 0.396826 Sep 14 12:09:14.563109 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 232/448] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:14 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1516 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:15.205219 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:15.206520 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:15.215995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:15.216528 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:15.217040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:15.217708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:15.218202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:15.218652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:15.265782 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:15.266789 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:15.267233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:15.267679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lazy-loading 'fault' on Instance uuid db89dc1f-418a-4442-835d-d99bf7ccba9e {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:09:15.312812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:15.321053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-63dbef79-147a-4e9e-ab5d-6ba9b66b7579 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1304 microversion: 2.1 time: 0.122207 Sep 14 12:09:15.325126 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 217/449] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:15 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:15.402562 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-639f75fe-1380-4c0e-8d92-df82a72bd503 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:15.411618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-639f75fe-1380-4c0e-8d92-df82a72bd503 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:15.411618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-639f75fe-1380-4c0e-8d92-df82a72bd503 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:15.411618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-639f75fe-1380-4c0e-8d92-df82a72bd503 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:15.411618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-639f75fe-1380-4c0e-8d92-df82a72bd503 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:15.412014 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-639f75fe-1380-4c0e-8d92-df82a72bd503 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:15.412436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-639f75fe-1380-4c0e-8d92-df82a72bd503 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:15.412865 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-639f75fe-1380-4c0e-8d92-df82a72bd503 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:15.592804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-639f75fe-1380-4c0e-8d92-df82a72bd503 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:15.601046 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-639f75fe-1380-4c0e-8d92-df82a72bd503 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.202948 Sep 14 12:09:15.601633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 233/450] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:15 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:16.362251 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:16.362883 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:16.370373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:16.370877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:16.371319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:16.372092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:16.372553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:16.372987 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:16.409752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:16.410452 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:16.410937 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:16.411414 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lazy-loading 'fault' on Instance uuid db89dc1f-418a-4442-835d-d99bf7ccba9e {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:09:16.464993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:16.480752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e5aefdca-0e76-4581-adae-1b42656a8f2a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1304 microversion: 2.1 time: 0.125300 Sep 14 12:09:16.481633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 218/451] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:16 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:16.631816 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4458967a-d5d0-474a-85bb-6c9aabd14def tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:16.632378 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4458967a-d5d0-474a-85bb-6c9aabd14def tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:16.640539 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4458967a-d5d0-474a-85bb-6c9aabd14def tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:16.641845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4458967a-d5d0-474a-85bb-6c9aabd14def tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:16.642404 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4458967a-d5d0-474a-85bb-6c9aabd14def tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:16.643172 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4458967a-d5d0-474a-85bb-6c9aabd14def tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:16.643663 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4458967a-d5d0-474a-85bb-6c9aabd14def tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:16.644267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4458967a-d5d0-474a-85bb-6c9aabd14def tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:16.789175 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4458967a-d5d0-474a-85bb-6c9aabd14def tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:16.797943 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4458967a-d5d0-474a-85bb-6c9aabd14def tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.170590 Sep 14 12:09:16.798546 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 234/452] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:16 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:17.508303 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:17.508953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:17.515948 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:17.516445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:17.516900 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:17.517903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:17.518558 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:17.519136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:17.541116 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-75d87a18-9eb4-452f-84b6-cead14d44619 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'create', calling method: .version_select at 0x7f1c99ec44c0>, body: {"keypair": {"name": "tempest-keypair-1508153332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/IVIwxODxBagqhzh1ug6t40fhltIyPYwl3uB48Np8pSWuxEME7uanmtmsqWr9DRg7ztTe5odv0A8Id9ze3WLD2z9hXR7BA34THnp828OOVL21fmzz2nVQ13YF1F3fj4Q=="}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:17.557606 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:17.558168 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:17.558714 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:17.559336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lazy-loading 'fault' on Instance uuid db89dc1f-418a-4442-835d-d99bf7ccba9e {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:09:17.562284 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-75d87a18-9eb4-452f-84b6-cead14d44619 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Getting quotas for project 748b7c08460b4f718dfff67275d8e4e4. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:09:17.567685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-75d87a18-9eb4-452f-84b6-cead14d44619 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Getting quotas for user 4bd4125ff6bb400bae1b94df7d2cfa17 and project 748b7c08460b4f718dfff67275d8e4e4. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:09:17.611229 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:17.619226 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8acf9ec1-8948-4342-87b5-4419432bf989 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1304 microversion: 2.1 time: 0.115354 Sep 14 12:09:17.620457 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 219/453] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:17 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:17.701517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-75d87a18-9eb4-452f-84b6-cead14d44619 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164118 Sep 14 12:09:17.702321 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 235/454] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 14 12:09:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:09:17.820782 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d3a462f4-6e6c-4153-8cdf-f333a61a4f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:17.821507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d3a462f4-6e6c-4153-8cdf-f333a61a4f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:17.827723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3a462f4-6e6c-4153-8cdf-f333a61a4f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:17.828293 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3a462f4-6e6c-4153-8cdf-f333a61a4f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:17.829779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3a462f4-6e6c-4153-8cdf-f333a61a4f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:17.830607 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3a462f4-6e6c-4153-8cdf-f333a61a4f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:17.831123 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3a462f4-6e6c-4153-8cdf-f333a61a4f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:17.831620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3a462f4-6e6c-4153-8cdf-f333a61a4f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:17.996368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d3a462f4-6e6c-4153-8cdf-f333a61a4f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:18.009228 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d3a462f4-6e6c-4153-8cdf-f333a61a4f35 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.192055 Sep 14 12:09:18.012658 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 220/455] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:17 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:18.650375 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:18.651548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:18.659313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:18.664758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:18.664758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:18.664758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:18.664758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:18.665423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:18.730199 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:18.731131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:18.731269 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:18.731679 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lazy-loading 'fault' on Instance uuid db89dc1f-418a-4442-835d-d99bf7ccba9e {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:09:18.917947 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:18.926449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-81de161e-a907-4830-8fb4-aa12095267bd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 200 len: 1304 microversion: 2.1 time: 0.285647 Sep 14 12:09:18.927035 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 236/456] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:18 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 1304 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:19.034262 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ac7f65ad-cef9-4e00-9b08-28c34828ad5e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:19.035050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ac7f65ad-cef9-4e00-9b08-28c34828ad5e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:19.042200 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac7f65ad-cef9-4e00-9b08-28c34828ad5e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:19.042688 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac7f65ad-cef9-4e00-9b08-28c34828ad5e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:19.043289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac7f65ad-cef9-4e00-9b08-28c34828ad5e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:19.044155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac7f65ad-cef9-4e00-9b08-28c34828ad5e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:19.044804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac7f65ad-cef9-4e00-9b08-28c34828ad5e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:19.045243 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac7f65ad-cef9-4e00-9b08-28c34828ad5e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:19.224254 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ac7f65ad-cef9-4e00-9b08-28c34828ad5e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:19.246933 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ac7f65ad-cef9-4e00-9b08-28c34828ad5e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.217467 Sep 14 12:09:19.249029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 221/457] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:19 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:19.950197 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:19.950890 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: db89dc1f-418a-4442-835d-d99bf7ccba9e] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:19.958103 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:19.958685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:19.959229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:19.960139 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:19.960673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:19.961170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:19.976172 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] HTTP exception thrown: Instance db89dc1f-418a-4442-835d-d99bf7ccba9e could not be found. Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Request method failure captured: Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e HTTP/1.1 Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcQ5dpZE_4FZ8mcxQrjGsC8BIyHfw_M6fJsyiyxcq-q-jZVBzYHXrFa1IfwVnCyxEXraDd0HvXN3hDRazEQJYP9oUsseFFBfB_3M5vL3ssIph_xAvyCMNkldaWdXXg2AACa4LlUGvXfHOT8Dg19hxAWQ_DvShD-Cz_4XtXiPZn8JEyA Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 2e692d812c3842608e10769277212d85 Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesActionsTest-1504011276 Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:09:19.977948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2e692d812c3842608e10769277212d85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2e692d812c3842608e10769277212d85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2e692d812c3842608e10769277212d85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2e692d812c3842608e10769277212d85"}]}] Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesActionsTest-1504011276 Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 2e692d812c3842608e10769277212d85 Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesActionsTest-1504011276 Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesActionsTest-1504011276-project Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: e133fb1749004c36a38ac028782294e2 Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesActionsTest-1504011276-project Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance db89dc1f-418a-4442-835d-d99bf7ccba9e could not be found. Sep 14 12:09:19.980604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'db89dc1f-418a-4442-835d-d99bf7ccba9e'} Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db89dc1f-418a-4442-835d-d99bf7ccba9e could not be found. Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:09:19.981566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db89dc1f-418a-4442-835d-d99bf7ccba9e could not be found. Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db89dc1f-418a-4442-835d-d99bf7ccba9e could not be found. Sep 14 12:09:19.983183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:09:19.984530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Returning 404 to user: Instance db89dc1f-418a-4442-835d-d99bf7ccba9e could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:09:19.984530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6eccfd35-cbab-4472-a571-ad2f1a46cf82 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e" status: 404 len: 111 microversion: 2.1 time: 0.034137 Sep 14 12:09:19.984530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 237/458] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:19 2022] GET /compute/v2.1/servers/db89dc1f-418a-4442-835d-d99bf7ccba9e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:09:20.102040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1643416624", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "networks": [{"uuid": "9135ef43-953f-4132-bfad-90e682eae5df"}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:20.169608 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] validate_networks() for [('9135ef43-953f-4132-bfad-90e682eae5df', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:09:20.272818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9769348b-cd40-48d0-ad60-29ff3a2cc421 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:20.273803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9769348b-cd40-48d0-ad60-29ff3a2cc421 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:20.284453 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9769348b-cd40-48d0-ad60-29ff3a2cc421 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:20.285226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9769348b-cd40-48d0-ad60-29ff3a2cc421 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:20.285934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9769348b-cd40-48d0-ad60-29ff3a2cc421 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:20.286876 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9769348b-cd40-48d0-ad60-29ff3a2cc421 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:20.287548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9769348b-cd40-48d0-ad60-29ff3a2cc421 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:20.288229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9769348b-cd40-48d0-ad60-29ff3a2cc421 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:20.532990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9769348b-cd40-48d0-ad60-29ff3a2cc421 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:20.543101 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9769348b-cd40-48d0-ad60-29ff3a2cc421 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.274146 Sep 14 12:09:20.548036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 238/459] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:20 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:20.676845 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:09:20.677196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:09:20.677671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:09:20.678212 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:09:20.678632 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:09:20.690007 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:20.691603 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:20.692117 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:20.693412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:20.694067 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:20.695092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:20.718265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Getting quotas for project 2e692d812c3842608e10769277212d85. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:09:20.724890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Getting quotas for user e133fb1749004c36a38ac028782294e2 and project 2e692d812c3842608e10769277212d85. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:09:20.737410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:09:20.739856 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:09:20.990283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c894c3a5-29d9-4472-bdb9-5c4d3bc3a424 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892667 Sep 14 12:09:20.991545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 222/460] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:09:21.007626 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5973f4c4-7050-4f6f-b264-855602699c97 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:21.010402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5973f4c4-7050-4f6f-b264-855602699c97 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:21.070273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5973f4c4-7050-4f6f-b264-855602699c97 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:21.077505 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5973f4c4-7050-4f6f-b264-855602699c97 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1214 microversion: 2.1 time: 0.078351 Sep 14 12:09:21.083010 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 239/461] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:20 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:21.107798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-2096d1f5-3c39-40e5-9192-14e4997c8b5f req-f83df7df-3100-4914-9df0-f9cf8d8da94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991ad790-ed34-4f78-9db4-91ad889c3c47", "name": "network-vif-plugged", "status": "completed", "tag": "de246217-d047-4d75-a069-3f9ac78fe2d2"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:21.122472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2096d1f5-3c39-40e5-9192-14e4997c8b5f req-f83df7df-3100-4914-9df0-f9cf8d8da94b service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:21.122962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2096d1f5-3c39-40e5-9192-14e4997c8b5f req-f83df7df-3100-4914-9df0-f9cf8d8da94b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:21.123494 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2096d1f5-3c39-40e5-9192-14e4997c8b5f req-f83df7df-3100-4914-9df0-f9cf8d8da94b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:21.137909 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-2096d1f5-3c39-40e5-9192-14e4997c8b5f req-f83df7df-3100-4914-9df0-f9cf8d8da94b service nova] Creating event network-vif-plugged:de246217-d047-4d75-a069-3f9ac78fe2d2 for instance 991ad790-ed34-4f78-9db4-91ad889c3c47 on hv-cinder-84496 Sep 14 12:09:21.149952 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-2096d1f5-3c39-40e5-9192-14e4997c8b5f req-f83df7df-3100-4914-9df0-f9cf8d8da94b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049280 Sep 14 12:09:21.150777 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 223/462] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:09:21.269775 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-105076847", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "644a779f-cf29-481b-810a-522abcbb7388"}], "security_groups": [{"name": "tempest-securitygroup--455656971"}], "key_name": "tempest-keypair-1508153332", "user_data": "}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:21.407537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.network.neutron [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] validate_networks() for [('644a779f-cf29-481b-810a-522abcbb7388', None, None, None, None, None)] {{(pid=121152) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:09:21.576213 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-16633ab1-68be-46ed-9937-91d815a857fe tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:21.577594 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-16633ab1-68be-46ed-9937-91d815a857fe tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:21.590856 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16633ab1-68be-46ed-9937-91d815a857fe tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:21.591799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16633ab1-68be-46ed-9937-91d815a857fe tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:21.592665 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16633ab1-68be-46ed-9937-91d815a857fe tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:21.593909 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16633ab1-68be-46ed-9937-91d815a857fe tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:21.594885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16633ab1-68be-46ed-9937-91d815a857fe tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:21.595661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16633ab1-68be-46ed-9937-91d815a857fe tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:21.911770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-16633ab1-68be-46ed-9937-91d815a857fe tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:21.920596 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-16633ab1-68be-46ed-9937-91d815a857fe tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.352544 Sep 14 12:09:21.921183 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 224/463] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:21 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:22.000259 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Flavor limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:09:22.000693 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Image limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:09:22.001197 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Flavor pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:09:22.001605 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Image pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:09:22.002061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:09:22.011835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:22.013162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:22.013162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:22.013162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:22.014725 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:22.014725 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:22.031373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Getting quotas for project 748b7c08460b4f718dfff67275d8e4e4. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:09:22.036101 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Getting quotas for user 4bd4125ff6bb400bae1b94df7d2cfa17 and project 748b7c08460b4f718dfff67275d8e4e4. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:09:22.047340 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Going to run 1 instances... {{(pid=121152) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:09:22.049746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:09:22.101647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7336d04c-1cbe-47c0-b517-19ebabe1418e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:22.102345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7336d04c-1cbe-47c0-b517-19ebabe1418e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:22.108392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7336d04c-1cbe-47c0-b517-19ebabe1418e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:22.108989 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7336d04c-1cbe-47c0-b517-19ebabe1418e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:22.109304 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7336d04c-1cbe-47c0-b517-19ebabe1418e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:22.110084 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7336d04c-1cbe-47c0-b517-19ebabe1418e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:22.110539 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7336d04c-1cbe-47c0-b517-19ebabe1418e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:22.110962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7336d04c-1cbe-47c0-b517-19ebabe1418e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:22.159980 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d782ef2a-5d49-4b65-8a9e-e7533c830de4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.897215 Sep 14 12:09:22.160640 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 240/464] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:09:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:09:22.172055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cf7ee02c-0722-4e3b-9983-ae6a611d68ad tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:22.172675 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cf7ee02c-0722-4e3b-9983-ae6a611d68ad tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:22.193275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7336d04c-1cbe-47c0-b517-19ebabe1418e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:22.202514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7336d04c-1cbe-47c0-b517-19ebabe1418e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1218 microversion: 2.1 time: 0.104485 Sep 14 12:09:22.203105 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 225/465] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:22 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:22.245167 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cf7ee02c-0722-4e3b-9983-ae6a611d68ad tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:22.256979 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cf7ee02c-0722-4e3b-9983-ae6a611d68ad tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1245 microversion: 2.1 time: 0.088587 Sep 14 12:09:22.257572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 241/466] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:22 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:22.944377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9ebaa658-b2a3-442d-a1c7-646b71425865 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:22.944985 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9ebaa658-b2a3-442d-a1c7-646b71425865 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:22.951859 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ebaa658-b2a3-442d-a1c7-646b71425865 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:22.952514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ebaa658-b2a3-442d-a1c7-646b71425865 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:22.953124 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ebaa658-b2a3-442d-a1c7-646b71425865 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:22.953945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ebaa658-b2a3-442d-a1c7-646b71425865 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:22.954491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ebaa658-b2a3-442d-a1c7-646b71425865 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:22.954958 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ebaa658-b2a3-442d-a1c7-646b71425865 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:23.088688 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9ebaa658-b2a3-442d-a1c7-646b71425865 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:23.097027 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9ebaa658-b2a3-442d-a1c7-646b71425865 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.156953 Sep 14 12:09:23.097680 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 226/467] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:22 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:23.226746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b7d38160-4e1f-4db2-8bf3-ff76817048e2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:23.227360 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b7d38160-4e1f-4db2-8bf3-ff76817048e2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:23.233726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7d38160-4e1f-4db2-8bf3-ff76817048e2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:23.234309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7d38160-4e1f-4db2-8bf3-ff76817048e2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:23.234820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7d38160-4e1f-4db2-8bf3-ff76817048e2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:23.236041 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7d38160-4e1f-4db2-8bf3-ff76817048e2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:23.236505 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7d38160-4e1f-4db2-8bf3-ff76817048e2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:23.236932 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b7d38160-4e1f-4db2-8bf3-ff76817048e2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:23.283793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cfb0582f-cd4d-423d-bbf0-edaea763037a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:23.284530 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cfb0582f-cd4d-423d-bbf0-edaea763037a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:23.291528 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfb0582f-cd4d-423d-bbf0-edaea763037a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:23.292102 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfb0582f-cd4d-423d-bbf0-edaea763037a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:23.292550 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfb0582f-cd4d-423d-bbf0-edaea763037a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:23.293258 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfb0582f-cd4d-423d-bbf0-edaea763037a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:23.293720 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfb0582f-cd4d-423d-bbf0-edaea763037a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:23.294179 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfb0582f-cd4d-423d-bbf0-edaea763037a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:23.303986 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b7d38160-4e1f-4db2-8bf3-ff76817048e2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:23.311901 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b7d38160-4e1f-4db2-8bf3-ff76817048e2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1218 microversion: 2.1 time: 0.089084 Sep 14 12:09:23.312800 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 242/468] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:23 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:23.363569 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cfb0582f-cd4d-423d-bbf0-edaea763037a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:23.371597 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cfb0582f-cd4d-423d-bbf0-edaea763037a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1249 microversion: 2.1 time: 0.092054 Sep 14 12:09:23.372184 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 227/469] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:23 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:24.120924 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-026d2947-848b-4917-8fd3-4a18e15e0c8a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:24.121564 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-026d2947-848b-4917-8fd3-4a18e15e0c8a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:24.128770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-026d2947-848b-4917-8fd3-4a18e15e0c8a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:24.129260 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-026d2947-848b-4917-8fd3-4a18e15e0c8a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:24.129749 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-026d2947-848b-4917-8fd3-4a18e15e0c8a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:24.137194 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-026d2947-848b-4917-8fd3-4a18e15e0c8a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:24.137194 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-026d2947-848b-4917-8fd3-4a18e15e0c8a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:24.137194 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-026d2947-848b-4917-8fd3-4a18e15e0c8a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:24.270259 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-026d2947-848b-4917-8fd3-4a18e15e0c8a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:24.279430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-026d2947-848b-4917-8fd3-4a18e15e0c8a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1318 microversion: 2.1 time: 0.162193 Sep 14 12:09:24.280078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 243/470] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:24 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:24.335261 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9963bd48-0d78-4606-9eb2-ba2d9f143065 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:24.336133 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9963bd48-0d78-4606-9eb2-ba2d9f143065 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:24.345108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9963bd48-0d78-4606-9eb2-ba2d9f143065 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:24.345609 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9963bd48-0d78-4606-9eb2-ba2d9f143065 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:24.346082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9963bd48-0d78-4606-9eb2-ba2d9f143065 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:24.346799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9963bd48-0d78-4606-9eb2-ba2d9f143065 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:24.347282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9963bd48-0d78-4606-9eb2-ba2d9f143065 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:24.347716 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9963bd48-0d78-4606-9eb2-ba2d9f143065 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:24.397344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-75e16adc-8841-4205-968f-0da252fd93e0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:24.398376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-75e16adc-8841-4205-968f-0da252fd93e0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:24.406291 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75e16adc-8841-4205-968f-0da252fd93e0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:24.407446 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75e16adc-8841-4205-968f-0da252fd93e0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:24.407889 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75e16adc-8841-4205-968f-0da252fd93e0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:24.408576 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75e16adc-8841-4205-968f-0da252fd93e0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:24.409019 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75e16adc-8841-4205-968f-0da252fd93e0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:24.409434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75e16adc-8841-4205-968f-0da252fd93e0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:24.419703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9963bd48-0d78-4606-9eb2-ba2d9f143065 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:24.431242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9963bd48-0d78-4606-9eb2-ba2d9f143065 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1266 microversion: 2.1 time: 0.100074 Sep 14 12:09:24.431836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 228/471] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:24 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:24.475854 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-75e16adc-8841-4205-968f-0da252fd93e0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:24.484037 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-75e16adc-8841-4205-968f-0da252fd93e0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1241 microversion: 2.1 time: 0.092695 Sep 14 12:09:24.484654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 244/472] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:24 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:25.303995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a69f174e-70b1-4361-816d-125d4fb9c448 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:25.304496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a69f174e-70b1-4361-816d-125d4fb9c448 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:25.310924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a69f174e-70b1-4361-816d-125d4fb9c448 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:25.311412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a69f174e-70b1-4361-816d-125d4fb9c448 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:25.311845 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a69f174e-70b1-4361-816d-125d4fb9c448 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:25.312538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a69f174e-70b1-4361-816d-125d4fb9c448 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:25.312983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a69f174e-70b1-4361-816d-125d4fb9c448 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:25.313915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a69f174e-70b1-4361-816d-125d4fb9c448 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:25.450764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a69f174e-70b1-4361-816d-125d4fb9c448 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:25.454822 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4ac88bae-c0da-4451-80d6-c4f314495196 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:25.455434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4ac88bae-c0da-4451-80d6-c4f314495196 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:25.461508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4ac88bae-c0da-4451-80d6-c4f314495196 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:25.470260 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a69f174e-70b1-4361-816d-125d4fb9c448 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1507 microversion: 2.1 time: 0.161767 Sep 14 12:09:25.470432 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4ac88bae-c0da-4451-80d6-c4f314495196 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:25.470432 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4ac88bae-c0da-4451-80d6-c4f314495196 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:25.470624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 229/473] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:25 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:25.470716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4ac88bae-c0da-4451-80d6-c4f314495196 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:25.470716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4ac88bae-c0da-4451-80d6-c4f314495196 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:25.470716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4ac88bae-c0da-4451-80d6-c4f314495196 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:25.508852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6000a25d-67db-406b-8314-1ccc99050f83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:25.509605 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6000a25d-67db-406b-8314-1ccc99050f83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:25.515746 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6000a25d-67db-406b-8314-1ccc99050f83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:25.516244 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6000a25d-67db-406b-8314-1ccc99050f83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:25.516729 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6000a25d-67db-406b-8314-1ccc99050f83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:25.517829 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6000a25d-67db-406b-8314-1ccc99050f83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:25.518425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6000a25d-67db-406b-8314-1ccc99050f83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:25.518745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6000a25d-67db-406b-8314-1ccc99050f83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:25.537013 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4ac88bae-c0da-4451-80d6-c4f314495196 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:25.542779 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4ac88bae-c0da-4451-80d6-c4f314495196 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1266 microversion: 2.1 time: 0.092305 Sep 14 12:09:25.543820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 245/474] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:25 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:25.598310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6000a25d-67db-406b-8314-1ccc99050f83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:25.605107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6000a25d-67db-406b-8314-1ccc99050f83 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1241 microversion: 2.1 time: 0.100801 Sep 14 12:09:25.605684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 230/475] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:25 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:26.568593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-08a1f76f-26a6-4526-837d-d19f0c9175dd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:26.569196 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-08a1f76f-26a6-4526-837d-d19f0c9175dd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:26.575180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-08a1f76f-26a6-4526-837d-d19f0c9175dd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:26.575880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-08a1f76f-26a6-4526-837d-d19f0c9175dd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:26.576311 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-08a1f76f-26a6-4526-837d-d19f0c9175dd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:26.577040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-08a1f76f-26a6-4526-837d-d19f0c9175dd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:26.577806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-08a1f76f-26a6-4526-837d-d19f0c9175dd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:26.578281 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-08a1f76f-26a6-4526-837d-d19f0c9175dd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:26.629584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f41ef738-a5e1-41fb-b9f6-9fa65690c93d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:26.630494 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f41ef738-a5e1-41fb-b9f6-9fa65690c93d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:26.637048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f41ef738-a5e1-41fb-b9f6-9fa65690c93d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:26.637628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f41ef738-a5e1-41fb-b9f6-9fa65690c93d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:26.638169 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f41ef738-a5e1-41fb-b9f6-9fa65690c93d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:26.638945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f41ef738-a5e1-41fb-b9f6-9fa65690c93d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:26.639526 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f41ef738-a5e1-41fb-b9f6-9fa65690c93d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:26.640100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f41ef738-a5e1-41fb-b9f6-9fa65690c93d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:26.733256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f41ef738-a5e1-41fb-b9f6-9fa65690c93d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:26.742213 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f41ef738-a5e1-41fb-b9f6-9fa65690c93d tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1297 microversion: 2.1 time: 0.117415 Sep 14 12:09:26.742890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 231/476] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:26 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:26.779001 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-08a1f76f-26a6-4526-837d-d19f0c9175dd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:26.786629 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-08a1f76f-26a6-4526-837d-d19f0c9175dd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.222021 Sep 14 12:09:26.787437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 246/477] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:26 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:27.765548 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e0cb3395-d36e-424a-928d-10d047270f95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:27.766766 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e0cb3395-d36e-424a-928d-10d047270f95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:27.773409 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0cb3395-d36e-424a-928d-10d047270f95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:27.773934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0cb3395-d36e-424a-928d-10d047270f95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:27.774631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0cb3395-d36e-424a-928d-10d047270f95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:27.775397 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0cb3395-d36e-424a-928d-10d047270f95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:27.775849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0cb3395-d36e-424a-928d-10d047270f95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:27.776275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0cb3395-d36e-424a-928d-10d047270f95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:27.784272 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:27.823896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5c562cf9-9a81-434f-b537-2bffe6f10bba tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:27.825292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5c562cf9-9a81-434f-b537-2bffe6f10bba tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:27.833777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c562cf9-9a81-434f-b537-2bffe6f10bba tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:27.834516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c562cf9-9a81-434f-b537-2bffe6f10bba tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:27.835043 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c562cf9-9a81-434f-b537-2bffe6f10bba tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:27.835931 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c562cf9-9a81-434f-b537-2bffe6f10bba tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:27.836486 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c562cf9-9a81-434f-b537-2bffe6f10bba tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:27.837211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c562cf9-9a81-434f-b537-2bffe6f10bba tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:27.893597 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e0cb3395-d36e-424a-928d-10d047270f95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:27.904274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e0cb3395-d36e-424a-928d-10d047270f95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1303 microversion: 2.1 time: 0.142540 Sep 14 12:09:27.904871 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 232/478] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:27 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:28.157738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5c562cf9-9a81-434f-b537-2bffe6f10bba tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:28.168713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5c562cf9-9a81-434f-b537-2bffe6f10bba tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.357622 Sep 14 12:09:28.169446 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 247/479] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:27 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:28.383055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-162b13d8-a21b-4393-ac6c-5de6e479bad5 req-1e640a99-1ca2-4e9f-809c-f525ee78326b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e08b9a-a9d4-482f-afcd-f9bef668d3dc", "tag": "314aabb7-f4cc-43ed-abf5-fd778e2e2ac3"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:28.394768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-162b13d8-a21b-4393-ac6c-5de6e479bad5 req-1e640a99-1ca2-4e9f-809c-f525ee78326b service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:28.395256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-162b13d8-a21b-4393-ac6c-5de6e479bad5 req-1e640a99-1ca2-4e9f-809c-f525ee78326b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:28.396115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-162b13d8-a21b-4393-ac6c-5de6e479bad5 req-1e640a99-1ca2-4e9f-809c-f525ee78326b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:28.408924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-162b13d8-a21b-4393-ac6c-5de6e479bad5 req-1e640a99-1ca2-4e9f-809c-f525ee78326b service nova] Creating event network-changed:314aabb7-f4cc-43ed-abf5-fd778e2e2ac3 for instance 48e08b9a-a9d4-482f-afcd-f9bef668d3dc on hv-cinder-84496 Sep 14 12:09:28.414239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-162b13d8-a21b-4393-ac6c-5de6e479bad5 req-1e640a99-1ca2-4e9f-809c-f525ee78326b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034477 Sep 14 12:09:28.415000 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 233/480] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:09:28.930283 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-adb694df-482a-4b19-8b47-9b28ab0db5c1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:28.931045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-adb694df-482a-4b19-8b47-9b28ab0db5c1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:28.938164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-adb694df-482a-4b19-8b47-9b28ab0db5c1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:28.938762 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-adb694df-482a-4b19-8b47-9b28ab0db5c1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:28.939272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-adb694df-482a-4b19-8b47-9b28ab0db5c1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:28.940070 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-adb694df-482a-4b19-8b47-9b28ab0db5c1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:28.940597 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-adb694df-482a-4b19-8b47-9b28ab0db5c1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:28.941087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-adb694df-482a-4b19-8b47-9b28ab0db5c1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:29.197738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-54243c3e-364d-497e-9410-02485a922aaa tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:29.198960 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-54243c3e-364d-497e-9410-02485a922aaa tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:29.206789 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54243c3e-364d-497e-9410-02485a922aaa tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:29.206789 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54243c3e-364d-497e-9410-02485a922aaa tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:29.207642 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54243c3e-364d-497e-9410-02485a922aaa tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:29.208440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54243c3e-364d-497e-9410-02485a922aaa tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:29.208983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54243c3e-364d-497e-9410-02485a922aaa tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:29.209387 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54243c3e-364d-497e-9410-02485a922aaa tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:29.277314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-adb694df-482a-4b19-8b47-9b28ab0db5c1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:29.288067 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-adb694df-482a-4b19-8b47-9b28ab0db5c1 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.361966 Sep 14 12:09:29.290752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 248/481] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:28 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:29.573878 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-54243c3e-364d-497e-9410-02485a922aaa tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:29.582598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-54243c3e-364d-497e-9410-02485a922aaa tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.393594 Sep 14 12:09:29.583206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 234/482] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:29 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:30.321461 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-79fb2726-382f-487a-a8e0-af9ccd543e31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:30.322352 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-79fb2726-382f-487a-a8e0-af9ccd543e31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:30.329898 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79fb2726-382f-487a-a8e0-af9ccd543e31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:30.330415 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79fb2726-382f-487a-a8e0-af9ccd543e31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:30.330927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79fb2726-382f-487a-a8e0-af9ccd543e31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:30.331795 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79fb2726-382f-487a-a8e0-af9ccd543e31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:30.332340 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79fb2726-382f-487a-a8e0-af9ccd543e31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:30.332832 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79fb2726-382f-487a-a8e0-af9ccd543e31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:30.486169 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-b148cea3-4771-405d-b458-00af1845a4ef req-89d9f28d-3258-4aea-8f86-b0aa0f3a9251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1", "tag": "027c61fc-efa6-4219-96b2-fd9ae33eb05c"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:30.497554 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b148cea3-4771-405d-b458-00af1845a4ef req-89d9f28d-3258-4aea-8f86-b0aa0f3a9251 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:30.498213 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b148cea3-4771-405d-b458-00af1845a4ef req-89d9f28d-3258-4aea-8f86-b0aa0f3a9251 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:30.498726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b148cea3-4771-405d-b458-00af1845a4ef req-89d9f28d-3258-4aea-8f86-b0aa0f3a9251 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:30.513713 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-b148cea3-4771-405d-b458-00af1845a4ef req-89d9f28d-3258-4aea-8f86-b0aa0f3a9251 service nova] Creating event network-changed:027c61fc-efa6-4219-96b2-fd9ae33eb05c for instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 on hv-cinder-84496 Sep 14 12:09:30.520809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-b148cea3-4771-405d-b458-00af1845a4ef req-89d9f28d-3258-4aea-8f86-b0aa0f3a9251 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038458 Sep 14 12:09:30.522318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 235/483] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:09:30.539352 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-79fb2726-382f-487a-a8e0-af9ccd543e31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:30.555148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-79fb2726-382f-487a-a8e0-af9ccd543e31 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.238292 Sep 14 12:09:30.555812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 249/484] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:30 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:30.607462 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-163c94d0-b8d2-4c17-9e7e-82e0a7f7701e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:30.608540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-163c94d0-b8d2-4c17-9e7e-82e0a7f7701e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:30.616179 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-163c94d0-b8d2-4c17-9e7e-82e0a7f7701e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:30.616679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-163c94d0-b8d2-4c17-9e7e-82e0a7f7701e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:30.617209 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-163c94d0-b8d2-4c17-9e7e-82e0a7f7701e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:30.621841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-163c94d0-b8d2-4c17-9e7e-82e0a7f7701e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:30.621841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-163c94d0-b8d2-4c17-9e7e-82e0a7f7701e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:30.621841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-163c94d0-b8d2-4c17-9e7e-82e0a7f7701e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:30.705030 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:30.738064 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=6 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:30.811459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-163c94d0-b8d2-4c17-9e7e-82e0a7f7701e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:30.820577 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-163c94d0-b8d2-4c17-9e7e-82e0a7f7701e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.217056 Sep 14 12:09:30.822946 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 236/485] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:30 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:31.583909 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-672b6c15-ed2a-47f1-a763-a8fc66a642c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:31.584440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-672b6c15-ed2a-47f1-a763-a8fc66a642c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:31.590498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-672b6c15-ed2a-47f1-a763-a8fc66a642c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:31.590984 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-672b6c15-ed2a-47f1-a763-a8fc66a642c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:31.591424 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-672b6c15-ed2a-47f1-a763-a8fc66a642c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:31.592136 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-672b6c15-ed2a-47f1-a763-a8fc66a642c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:31.592589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-672b6c15-ed2a-47f1-a763-a8fc66a642c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:31.593010 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-672b6c15-ed2a-47f1-a763-a8fc66a642c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:31.747277 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-672b6c15-ed2a-47f1-a763-a8fc66a642c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:31.755327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-672b6c15-ed2a-47f1-a763-a8fc66a642c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.175470 Sep 14 12:09:31.755901 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 250/486] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:31 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:31.855835 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-87d9d350-7f6f-4c53-9e97-499166b6a47d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:31.856445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-87d9d350-7f6f-4c53-9e97-499166b6a47d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:31.863511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87d9d350-7f6f-4c53-9e97-499166b6a47d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:31.863993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87d9d350-7f6f-4c53-9e97-499166b6a47d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:31.864474 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87d9d350-7f6f-4c53-9e97-499166b6a47d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:31.865161 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87d9d350-7f6f-4c53-9e97-499166b6a47d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:31.865612 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87d9d350-7f6f-4c53-9e97-499166b6a47d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:31.866084 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87d9d350-7f6f-4c53-9e97-499166b6a47d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:31.998803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-87d9d350-7f6f-4c53-9e97-499166b6a47d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:32.006958 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-87d9d350-7f6f-4c53-9e97-499166b6a47d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.155392 Sep 14 12:09:32.007528 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 237/487] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:31 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:32.779278 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-13494c22-4dec-4a03-b3a3-db5a19f806c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:32.779959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-13494c22-4dec-4a03-b3a3-db5a19f806c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:32.781964 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:32.783294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=14 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:32.788359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13494c22-4dec-4a03-b3a3-db5a19f806c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:32.788852 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13494c22-4dec-4a03-b3a3-db5a19f806c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:32.789294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13494c22-4dec-4a03-b3a3-db5a19f806c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:32.790047 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13494c22-4dec-4a03-b3a3-db5a19f806c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:32.790509 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13494c22-4dec-4a03-b3a3-db5a19f806c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:32.790936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13494c22-4dec-4a03-b3a3-db5a19f806c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:32.925677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-13494c22-4dec-4a03-b3a3-db5a19f806c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:32.933791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-13494c22-4dec-4a03-b3a3-db5a19f806c2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.158427 Sep 14 12:09:32.934420 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 251/488] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:32 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:33.031582 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-63af5d2a-c16c-47b6-bf0e-2d0a1182a1a3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:33.032189 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-63af5d2a-c16c-47b6-bf0e-2d0a1182a1a3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:33.040325 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63af5d2a-c16c-47b6-bf0e-2d0a1182a1a3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:33.040823 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63af5d2a-c16c-47b6-bf0e-2d0a1182a1a3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:33.041290 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63af5d2a-c16c-47b6-bf0e-2d0a1182a1a3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:33.042032 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63af5d2a-c16c-47b6-bf0e-2d0a1182a1a3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:33.042491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63af5d2a-c16c-47b6-bf0e-2d0a1182a1a3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:33.042918 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63af5d2a-c16c-47b6-bf0e-2d0a1182a1a3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:33.190201 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-63af5d2a-c16c-47b6-bf0e-2d0a1182a1a3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:33.198516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-63af5d2a-c16c-47b6-bf0e-2d0a1182a1a3 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.170796 Sep 14 12:09:33.199132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 238/489] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:33 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:33.957056 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fa0be242-b96b-4839-8ed6-a7c739bc2cb2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:33.957718 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-fa0be242-b96b-4839-8ed6-a7c739bc2cb2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:33.964415 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fa0be242-b96b-4839-8ed6-a7c739bc2cb2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:33.964902 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fa0be242-b96b-4839-8ed6-a7c739bc2cb2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:33.965428 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fa0be242-b96b-4839-8ed6-a7c739bc2cb2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:33.966590 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fa0be242-b96b-4839-8ed6-a7c739bc2cb2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:33.966743 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fa0be242-b96b-4839-8ed6-a7c739bc2cb2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:33.967175 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fa0be242-b96b-4839-8ed6-a7c739bc2cb2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:33.971789 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:34.117241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fa0be242-b96b-4839-8ed6-a7c739bc2cb2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:34.125900 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-fa0be242-b96b-4839-8ed6-a7c739bc2cb2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.172860 Sep 14 12:09:34.127133 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 252/490] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:33 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:34.222527 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6fc0c4c8-9eb0-4756-860c-940a0e7618d8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:34.223130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6fc0c4c8-9eb0-4756-860c-940a0e7618d8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:34.229512 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc0c4c8-9eb0-4756-860c-940a0e7618d8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:34.230027 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc0c4c8-9eb0-4756-860c-940a0e7618d8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:34.230462 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc0c4c8-9eb0-4756-860c-940a0e7618d8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:34.231147 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc0c4c8-9eb0-4756-860c-940a0e7618d8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:34.231593 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc0c4c8-9eb0-4756-860c-940a0e7618d8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:34.232011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fc0c4c8-9eb0-4756-860c-940a0e7618d8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:34.385767 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6fc0c4c8-9eb0-4756-860c-940a0e7618d8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:34.393371 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6fc0c4c8-9eb0-4756-860c-940a0e7618d8 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.175225 Sep 14 12:09:34.393954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 239/491] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:34 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:35.150544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-806fa278-e3a2-4871-9de4-88290183bd22 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:35.151154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-806fa278-e3a2-4871-9de4-88290183bd22 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:35.161130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-806fa278-e3a2-4871-9de4-88290183bd22 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:35.161130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-806fa278-e3a2-4871-9de4-88290183bd22 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:35.161130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-806fa278-e3a2-4871-9de4-88290183bd22 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:35.161130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-806fa278-e3a2-4871-9de4-88290183bd22 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:35.161492 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-806fa278-e3a2-4871-9de4-88290183bd22 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:35.161492 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-806fa278-e3a2-4871-9de4-88290183bd22 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:35.384061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-806fa278-e3a2-4871-9de4-88290183bd22 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:35.392168 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-806fa278-e3a2-4871-9de4-88290183bd22 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.245756 Sep 14 12:09:35.392765 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 253/492] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:35 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:35.418833 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1c98e38c-0755-4cb2-bbb1-ac203edd9939 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:35.419647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1c98e38c-0755-4cb2-bbb1-ac203edd9939 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:35.425489 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:35.429255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c98e38c-0755-4cb2-bbb1-ac203edd9939 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:35.429910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c98e38c-0755-4cb2-bbb1-ac203edd9939 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:35.430372 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c98e38c-0755-4cb2-bbb1-ac203edd9939 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:35.431091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c98e38c-0755-4cb2-bbb1-ac203edd9939 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:35.431613 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c98e38c-0755-4cb2-bbb1-ac203edd9939 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:35.432040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c98e38c-0755-4cb2-bbb1-ac203edd9939 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:35.586412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1c98e38c-0755-4cb2-bbb1-ac203edd9939 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:35.594077 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1c98e38c-0755-4cb2-bbb1-ac203edd9939 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.180397 Sep 14 12:09:35.594689 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 240/493] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:35 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:36.415132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4eb79652-b9ed-466b-bfe1-ae6fbf122ac2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:36.416011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4eb79652-b9ed-466b-bfe1-ae6fbf122ac2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:36.422171 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eb79652-b9ed-466b-bfe1-ae6fbf122ac2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:36.422652 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eb79652-b9ed-466b-bfe1-ae6fbf122ac2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:36.423090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eb79652-b9ed-466b-bfe1-ae6fbf122ac2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:36.424473 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eb79652-b9ed-466b-bfe1-ae6fbf122ac2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:36.424927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eb79652-b9ed-466b-bfe1-ae6fbf122ac2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:36.425351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eb79652-b9ed-466b-bfe1-ae6fbf122ac2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:36.568856 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4eb79652-b9ed-466b-bfe1-ae6fbf122ac2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:36.576742 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4eb79652-b9ed-466b-bfe1-ae6fbf122ac2 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.165567 Sep 14 12:09:36.577309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 254/494] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:36 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:36.619444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d1c24cc1-3aff-4e41-899d-207c8a1300b7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:36.620058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d1c24cc1-3aff-4e41-899d-207c8a1300b7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:36.628446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c24cc1-3aff-4e41-899d-207c8a1300b7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:36.628954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c24cc1-3aff-4e41-899d-207c8a1300b7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:36.629401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c24cc1-3aff-4e41-899d-207c8a1300b7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:36.630189 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c24cc1-3aff-4e41-899d-207c8a1300b7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:36.630661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c24cc1-3aff-4e41-899d-207c8a1300b7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:36.631102 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1c24cc1-3aff-4e41-899d-207c8a1300b7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:36.773122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d1c24cc1-3aff-4e41-899d-207c8a1300b7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:36.781265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d1c24cc1-3aff-4e41-899d-207c8a1300b7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.167557 Sep 14 12:09:36.781844 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 241/495] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:36 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:37.599606 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-78d23878-c56e-472f-98ab-8c0394daae93 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:37.600189 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-78d23878-c56e-472f-98ab-8c0394daae93 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:37.608613 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78d23878-c56e-472f-98ab-8c0394daae93 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:37.609444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78d23878-c56e-472f-98ab-8c0394daae93 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:37.610219 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78d23878-c56e-472f-98ab-8c0394daae93 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:37.611309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78d23878-c56e-472f-98ab-8c0394daae93 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:37.611798 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78d23878-c56e-472f-98ab-8c0394daae93 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:37.612226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78d23878-c56e-472f-98ab-8c0394daae93 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:37.748226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-78d23878-c56e-472f-98ab-8c0394daae93 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:37.756512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-78d23878-c56e-472f-98ab-8c0394daae93 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.161228 Sep 14 12:09:37.757104 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 255/496] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:37 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:37.803642 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-95b83f02-0414-4c1d-a122-1b5c4deb9f49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:37.804281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-95b83f02-0414-4c1d-a122-1b5c4deb9f49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:37.810761 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95b83f02-0414-4c1d-a122-1b5c4deb9f49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:37.811243 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95b83f02-0414-4c1d-a122-1b5c4deb9f49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:37.811677 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95b83f02-0414-4c1d-a122-1b5c4deb9f49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:37.812374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95b83f02-0414-4c1d-a122-1b5c4deb9f49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:37.812840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95b83f02-0414-4c1d-a122-1b5c4deb9f49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:37.813249 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-95b83f02-0414-4c1d-a122-1b5c4deb9f49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:37.912828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-0734cf21-dafb-4f1e-bbe6-f1d0a1ed88a6 req-fab7554e-c696-4d17-ba50-2d42bdd63731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e08b9a-a9d4-482f-afcd-f9bef668d3dc", "name": "network-vif-plugged", "status": "completed", "tag": "314aabb7-f4cc-43ed-abf5-fd778e2e2ac3"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:37.924167 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-0734cf21-dafb-4f1e-bbe6-f1d0a1ed88a6 req-fab7554e-c696-4d17-ba50-2d42bdd63731 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:37.924966 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-0734cf21-dafb-4f1e-bbe6-f1d0a1ed88a6 req-fab7554e-c696-4d17-ba50-2d42bdd63731 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:37.925582 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-0734cf21-dafb-4f1e-bbe6-f1d0a1ed88a6 req-fab7554e-c696-4d17-ba50-2d42bdd63731 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:37.939498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-0734cf21-dafb-4f1e-bbe6-f1d0a1ed88a6 req-fab7554e-c696-4d17-ba50-2d42bdd63731 service nova] Creating event network-vif-plugged:314aabb7-f4cc-43ed-abf5-fd778e2e2ac3 for instance 48e08b9a-a9d4-482f-afcd-f9bef668d3dc on hv-cinder-84496 Sep 14 12:09:37.945582 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-0734cf21-dafb-4f1e-bbe6-f1d0a1ed88a6 req-fab7554e-c696-4d17-ba50-2d42bdd63731 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036081 Sep 14 12:09:37.946485 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 256/497] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:09:37.969502 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-95b83f02-0414-4c1d-a122-1b5c4deb9f49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:37.977906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-95b83f02-0414-4c1d-a122-1b5c4deb9f49 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.178156 Sep 14 12:09:37.978510 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 242/498] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:37 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:38.781054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0b8a6151-00a6-454f-96bf-1acd228de428 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:38.781756 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0b8a6151-00a6-454f-96bf-1acd228de428 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:38.789233 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a6151-00a6-454f-96bf-1acd228de428 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:38.789724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a6151-00a6-454f-96bf-1acd228de428 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:38.790186 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a6151-00a6-454f-96bf-1acd228de428 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:38.790886 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a6151-00a6-454f-96bf-1acd228de428 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:38.791382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a6151-00a6-454f-96bf-1acd228de428 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:38.791831 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a6151-00a6-454f-96bf-1acd228de428 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:38.938382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0b8a6151-00a6-454f-96bf-1acd228de428 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:38.948864 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0b8a6151-00a6-454f-96bf-1acd228de428 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.172235 Sep 14 12:09:38.950179 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 257/499] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:38 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:39.002848 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e0ee4a15-c264-43b8-b3b6-94f6a39f235d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:39.003379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e0ee4a15-c264-43b8-b3b6-94f6a39f235d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:39.010135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0ee4a15-c264-43b8-b3b6-94f6a39f235d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:39.010624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0ee4a15-c264-43b8-b3b6-94f6a39f235d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:39.011065 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0ee4a15-c264-43b8-b3b6-94f6a39f235d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:39.011775 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0ee4a15-c264-43b8-b3b6-94f6a39f235d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:39.012233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0ee4a15-c264-43b8-b3b6-94f6a39f235d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:39.012661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e0ee4a15-c264-43b8-b3b6-94f6a39f235d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:39.172921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e0ee4a15-c264-43b8-b3b6-94f6a39f235d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:39.181505 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e0ee4a15-c264-43b8-b3b6-94f6a39f235d tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.184373 Sep 14 12:09:39.182138 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 243/500] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:38 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:39.972931 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b877448f-57d7-4b1d-876d-f87cc1d7a141 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:39.973479 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b877448f-57d7-4b1d-876d-f87cc1d7a141 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:39.975537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:39.983651 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b877448f-57d7-4b1d-876d-f87cc1d7a141 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:39.984156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b877448f-57d7-4b1d-876d-f87cc1d7a141 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:39.984753 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b877448f-57d7-4b1d-876d-f87cc1d7a141 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:39.986332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b877448f-57d7-4b1d-876d-f87cc1d7a141 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:39.987092 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b877448f-57d7-4b1d-876d-f87cc1d7a141 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:39.987864 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b877448f-57d7-4b1d-876d-f87cc1d7a141 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:40.128485 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b877448f-57d7-4b1d-876d-f87cc1d7a141 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:40.137138 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b877448f-57d7-4b1d-876d-f87cc1d7a141 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.168103 Sep 14 12:09:40.138093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 258/501] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:39 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:40.205241 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-75bc2f79-8115-473f-9766-fe59dc9844c1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:40.205897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-75bc2f79-8115-473f-9766-fe59dc9844c1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:40.212466 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75bc2f79-8115-473f-9766-fe59dc9844c1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:40.212957 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75bc2f79-8115-473f-9766-fe59dc9844c1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:40.213424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75bc2f79-8115-473f-9766-fe59dc9844c1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:40.214155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75bc2f79-8115-473f-9766-fe59dc9844c1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:40.214646 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75bc2f79-8115-473f-9766-fe59dc9844c1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:40.215156 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-75bc2f79-8115-473f-9766-fe59dc9844c1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:40.358948 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-75bc2f79-8115-473f-9766-fe59dc9844c1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:40.374033 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-75bc2f79-8115-473f-9766-fe59dc9844c1 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.172610 Sep 14 12:09:40.374656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 244/502] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:40 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:41.159672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4fd3d96a-05bf-4bb1-9949-7e5c56916b09 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:41.160244 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4fd3d96a-05bf-4bb1-9949-7e5c56916b09 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:41.166504 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3d96a-05bf-4bb1-9949-7e5c56916b09 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:41.167093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3d96a-05bf-4bb1-9949-7e5c56916b09 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:41.167478 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3d96a-05bf-4bb1-9949-7e5c56916b09 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:41.168175 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3d96a-05bf-4bb1-9949-7e5c56916b09 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:41.168630 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3d96a-05bf-4bb1-9949-7e5c56916b09 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:41.169054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4fd3d96a-05bf-4bb1-9949-7e5c56916b09 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:41.317061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4fd3d96a-05bf-4bb1-9949-7e5c56916b09 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:41.324784 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4fd3d96a-05bf-4bb1-9949-7e5c56916b09 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.169232 Sep 14 12:09:41.325353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 259/503] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:41 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:41.398521 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ec9748bc-b7ad-4462-bf6d-b6db0a64212e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:41.399260 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ec9748bc-b7ad-4462-bf6d-b6db0a64212e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:41.406101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ec9748bc-b7ad-4462-bf6d-b6db0a64212e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:41.406604 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ec9748bc-b7ad-4462-bf6d-b6db0a64212e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:41.407020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ec9748bc-b7ad-4462-bf6d-b6db0a64212e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:41.408332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ec9748bc-b7ad-4462-bf6d-b6db0a64212e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:41.408780 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ec9748bc-b7ad-4462-bf6d-b6db0a64212e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:41.409202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ec9748bc-b7ad-4462-bf6d-b6db0a64212e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:41.551388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ec9748bc-b7ad-4462-bf6d-b6db0a64212e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:41.559162 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ec9748bc-b7ad-4462-bf6d-b6db0a64212e tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.164985 Sep 14 12:09:41.561816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 245/504] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:41 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:42.348684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8c7239bf-f065-496f-8453-e8a0688b11bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:42.349289 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8c7239bf-f065-496f-8453-e8a0688b11bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:42.355307 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c7239bf-f065-496f-8453-e8a0688b11bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:42.355792 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c7239bf-f065-496f-8453-e8a0688b11bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:42.356232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c7239bf-f065-496f-8453-e8a0688b11bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:42.357011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c7239bf-f065-496f-8453-e8a0688b11bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:42.357373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c7239bf-f065-496f-8453-e8a0688b11bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:42.357832 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c7239bf-f065-496f-8453-e8a0688b11bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:42.490845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8c7239bf-f065-496f-8453-e8a0688b11bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:42.498386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8c7239bf-f065-496f-8453-e8a0688b11bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.154139 Sep 14 12:09:42.498973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 260/505] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:42 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:42.583105 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-20d39036-524c-4366-ae85-73e74cfc4d56 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:42.583721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-20d39036-524c-4366-ae85-73e74cfc4d56 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:42.590187 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20d39036-524c-4366-ae85-73e74cfc4d56 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:42.590681 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20d39036-524c-4366-ae85-73e74cfc4d56 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:42.591120 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20d39036-524c-4366-ae85-73e74cfc4d56 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:42.591806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20d39036-524c-4366-ae85-73e74cfc4d56 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:42.592259 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20d39036-524c-4366-ae85-73e74cfc4d56 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:42.592684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20d39036-524c-4366-ae85-73e74cfc4d56 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:42.728367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-20d39036-524c-4366-ae85-73e74cfc4d56 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:42.735971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-20d39036-524c-4366-ae85-73e74cfc4d56 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.157288 Sep 14 12:09:42.737066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 246/506] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:42 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:43.521785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a6371228-4199-44db-876a-c1e0bdff21d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:43.522431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a6371228-4199-44db-876a-c1e0bdff21d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:43.528701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a6371228-4199-44db-876a-c1e0bdff21d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:43.529245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a6371228-4199-44db-876a-c1e0bdff21d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:43.529627 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a6371228-4199-44db-876a-c1e0bdff21d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:43.530349 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a6371228-4199-44db-876a-c1e0bdff21d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:43.530803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a6371228-4199-44db-876a-c1e0bdff21d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:43.531227 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a6371228-4199-44db-876a-c1e0bdff21d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:43.671716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a6371228-4199-44db-876a-c1e0bdff21d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:43.679242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a6371228-4199-44db-876a-c1e0bdff21d5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.161774 Sep 14 12:09:43.679804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 261/507] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:43 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:43.760039 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-65ff76f0-2eac-4aa2-8a89-2572d9edd177 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:43.760651 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-65ff76f0-2eac-4aa2-8a89-2572d9edd177 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:43.767250 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65ff76f0-2eac-4aa2-8a89-2572d9edd177 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:43.767734 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65ff76f0-2eac-4aa2-8a89-2572d9edd177 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:43.768178 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65ff76f0-2eac-4aa2-8a89-2572d9edd177 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:43.768867 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65ff76f0-2eac-4aa2-8a89-2572d9edd177 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:43.769320 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65ff76f0-2eac-4aa2-8a89-2572d9edd177 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:43.769743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65ff76f0-2eac-4aa2-8a89-2572d9edd177 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:43.903005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-65ff76f0-2eac-4aa2-8a89-2572d9edd177 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:43.912725 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-65ff76f0-2eac-4aa2-8a89-2572d9edd177 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.156235 Sep 14 12:09:43.913289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 247/508] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:43 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:44.704040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6aee28f7-44a4-4d67-bea5-2174409ded7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:44.704673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6aee28f7-44a4-4d67-bea5-2174409ded7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:44.711404 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6aee28f7-44a4-4d67-bea5-2174409ded7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:44.711884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6aee28f7-44a4-4d67-bea5-2174409ded7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:44.712314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6aee28f7-44a4-4d67-bea5-2174409ded7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:44.713009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6aee28f7-44a4-4d67-bea5-2174409ded7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:44.713454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6aee28f7-44a4-4d67-bea5-2174409ded7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:44.713903 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6aee28f7-44a4-4d67-bea5-2174409ded7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:44.862373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6aee28f7-44a4-4d67-bea5-2174409ded7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:44.870656 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6aee28f7-44a4-4d67-bea5-2174409ded7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.170616 Sep 14 12:09:44.871327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 262/509] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:44 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:44.936070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-61aad2af-b101-4e2c-990c-bc2475f558a5 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:44.936673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-61aad2af-b101-4e2c-990c-bc2475f558a5 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:44.945083 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61aad2af-b101-4e2c-990c-bc2475f558a5 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:44.945686 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61aad2af-b101-4e2c-990c-bc2475f558a5 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:44.948026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61aad2af-b101-4e2c-990c-bc2475f558a5 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:44.948026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61aad2af-b101-4e2c-990c-bc2475f558a5 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:44.948026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61aad2af-b101-4e2c-990c-bc2475f558a5 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:44.948026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61aad2af-b101-4e2c-990c-bc2475f558a5 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:45.084478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-61aad2af-b101-4e2c-990c-bc2475f558a5 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:45.092207 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-61aad2af-b101-4e2c-990c-bc2475f558a5 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.159836 Sep 14 12:09:45.093065 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 248/510] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:44 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:45.895967 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3d214f75-763f-45ee-b128-7d6b2f63c37f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:45.896575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3d214f75-763f-45ee-b128-7d6b2f63c37f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:45.903834 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d214f75-763f-45ee-b128-7d6b2f63c37f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:45.908523 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d214f75-763f-45ee-b128-7d6b2f63c37f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:45.908523 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d214f75-763f-45ee-b128-7d6b2f63c37f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:45.908523 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d214f75-763f-45ee-b128-7d6b2f63c37f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:45.908523 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d214f75-763f-45ee-b128-7d6b2f63c37f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:45.908931 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d214f75-763f-45ee-b128-7d6b2f63c37f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:46.088488 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3d214f75-763f-45ee-b128-7d6b2f63c37f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:46.099914 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3d214f75-763f-45ee-b128-7d6b2f63c37f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.208142 Sep 14 12:09:46.100511 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 263/511] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:45 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:46.116536 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d2d6096d-923f-4a5e-819f-b5ca4c532502 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:46.117222 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d2d6096d-923f-4a5e-819f-b5ca4c532502 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:46.123887 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d6096d-923f-4a5e-819f-b5ca4c532502 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:46.124377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d6096d-923f-4a5e-819f-b5ca4c532502 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:46.124806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d6096d-923f-4a5e-819f-b5ca4c532502 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:46.126066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d6096d-923f-4a5e-819f-b5ca4c532502 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:46.126066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d6096d-923f-4a5e-819f-b5ca4c532502 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:46.126426 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d2d6096d-923f-4a5e-819f-b5ca4c532502 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:46.271390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d2d6096d-923f-4a5e-819f-b5ca4c532502 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:46.279406 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d2d6096d-923f-4a5e-819f-b5ca4c532502 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1314 microversion: 2.1 time: 0.167411 Sep 14 12:09:46.280044 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 249/512] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:46 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:47.124054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9d89061d-8bba-4efe-8847-e0b8b1be65d0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:47.124664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9d89061d-8bba-4efe-8847-e0b8b1be65d0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:47.131215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d89061d-8bba-4efe-8847-e0b8b1be65d0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:47.131702 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d89061d-8bba-4efe-8847-e0b8b1be65d0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:47.132309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d89061d-8bba-4efe-8847-e0b8b1be65d0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:47.132996 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d89061d-8bba-4efe-8847-e0b8b1be65d0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:47.133448 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d89061d-8bba-4efe-8847-e0b8b1be65d0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:47.133919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d89061d-8bba-4efe-8847-e0b8b1be65d0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:47.262167 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9d89061d-8bba-4efe-8847-e0b8b1be65d0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:47.270281 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9d89061d-8bba-4efe-8847-e0b8b1be65d0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.150130 Sep 14 12:09:47.270844 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 264/513] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:47 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:47.305886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0668226f-23a0-4690-b78f-7be712a5fd44 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:47.306506 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0668226f-23a0-4690-b78f-7be712a5fd44 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:47.312906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0668226f-23a0-4690-b78f-7be712a5fd44 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:47.313337 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0668226f-23a0-4690-b78f-7be712a5fd44 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:47.314426 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0668226f-23a0-4690-b78f-7be712a5fd44 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:47.315120 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0668226f-23a0-4690-b78f-7be712a5fd44 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:47.315665 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0668226f-23a0-4690-b78f-7be712a5fd44 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:47.316090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0668226f-23a0-4690-b78f-7be712a5fd44 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:47.320175 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:47.454590 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0668226f-23a0-4690-b78f-7be712a5fd44 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:47.464047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0668226f-23a0-4690-b78f-7be712a5fd44 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1498 microversion: 2.1 time: 0.161171 Sep 14 12:09:47.464047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 250/514] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:47 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:48.293944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ada8a959-019a-427a-9b99-fe7e36999b46 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:48.294494 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ada8a959-019a-427a-9b99-fe7e36999b46 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:48.302518 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ada8a959-019a-427a-9b99-fe7e36999b46 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:48.303012 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ada8a959-019a-427a-9b99-fe7e36999b46 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:48.303467 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ada8a959-019a-427a-9b99-fe7e36999b46 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:48.304169 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ada8a959-019a-427a-9b99-fe7e36999b46 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:48.304623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ada8a959-019a-427a-9b99-fe7e36999b46 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:48.305047 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ada8a959-019a-427a-9b99-fe7e36999b46 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:48.449615 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ada8a959-019a-427a-9b99-fe7e36999b46 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:48.458050 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ada8a959-019a-427a-9b99-fe7e36999b46 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.168015 Sep 14 12:09:48.458634 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 265/515] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:48 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:48.946504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ac2c4c0b-1728-43cb-943c-33a80459cae7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:48.947269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ac2c4c0b-1728-43cb-943c-33a80459cae7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:48.953885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c4c0b-1728-43cb-943c-33a80459cae7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:48.954417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c4c0b-1728-43cb-943c-33a80459cae7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:48.954851 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c4c0b-1728-43cb-943c-33a80459cae7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:48.955552 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c4c0b-1728-43cb-943c-33a80459cae7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:48.956751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c4c0b-1728-43cb-943c-33a80459cae7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:48.956751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac2c4c0b-1728-43cb-943c-33a80459cae7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:48.982816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ac2c4c0b-1728-43cb-943c-33a80459cae7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:09:49.288801 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ac2c4c0b-1728-43cb-943c-33a80459cae7 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "DELETE /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 204 len: 0 microversion: 2.1 time: 0.346585 Sep 14 12:09:49.289402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 251/516] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:09:48 2022] DELETE /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:09:49.297823 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-745a9059-077a-4d88-b8be-8b729ec83bbd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:49.298514 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-745a9059-077a-4d88-b8be-8b729ec83bbd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:49.304734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745a9059-077a-4d88-b8be-8b729ec83bbd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:49.305229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745a9059-077a-4d88-b8be-8b729ec83bbd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:49.305669 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745a9059-077a-4d88-b8be-8b729ec83bbd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:49.306408 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745a9059-077a-4d88-b8be-8b729ec83bbd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:49.306868 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745a9059-077a-4d88-b8be-8b729ec83bbd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:49.307292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-745a9059-077a-4d88-b8be-8b729ec83bbd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:49.453118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-745a9059-077a-4d88-b8be-8b729ec83bbd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:49.460980 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-745a9059-077a-4d88-b8be-8b729ec83bbd tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1504 microversion: 2.1 time: 0.167003 Sep 14 12:09:49.461560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 266/517] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:49 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:49.481809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2b4432ba-6dfb-468a-af2b-b6e64ed42b54 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:49.482636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2b4432ba-6dfb-468a-af2b-b6e64ed42b54 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:49.489689 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b4432ba-6dfb-468a-af2b-b6e64ed42b54 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:49.490221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b4432ba-6dfb-468a-af2b-b6e64ed42b54 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:49.490673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b4432ba-6dfb-468a-af2b-b6e64ed42b54 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:49.491382 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b4432ba-6dfb-468a-af2b-b6e64ed42b54 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:49.491836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b4432ba-6dfb-468a-af2b-b6e64ed42b54 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:49.492268 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b4432ba-6dfb-468a-af2b-b6e64ed42b54 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:49.632445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2b4432ba-6dfb-468a-af2b-b6e64ed42b54 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:49.642421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2b4432ba-6dfb-468a-af2b-b6e64ed42b54 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.165466 Sep 14 12:09:49.644640 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 252/518] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:49 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:50.484429 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d443ed13-b5ac-4aff-98c3-c6ca2cb1315a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:50.485078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d443ed13-b5ac-4aff-98c3-c6ca2cb1315a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:50.491599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d443ed13-b5ac-4aff-98c3-c6ca2cb1315a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:50.492090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d443ed13-b5ac-4aff-98c3-c6ca2cb1315a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:50.492530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d443ed13-b5ac-4aff-98c3-c6ca2cb1315a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:50.493272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d443ed13-b5ac-4aff-98c3-c6ca2cb1315a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:50.493768 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d443ed13-b5ac-4aff-98c3-c6ca2cb1315a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:50.494236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d443ed13-b5ac-4aff-98c3-c6ca2cb1315a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:50.642633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d443ed13-b5ac-4aff-98c3-c6ca2cb1315a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:50.650724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d443ed13-b5ac-4aff-98c3-c6ca2cb1315a tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1504 microversion: 2.1 time: 0.170398 Sep 14 12:09:50.651308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 267/519] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:50 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:50.666034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-775a8918-cac0-40cf-8a06-d507c0a37b58 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:50.667283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-775a8918-cac0-40cf-8a06-d507c0a37b58 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:50.674177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-775a8918-cac0-40cf-8a06-d507c0a37b58 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:50.675284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-775a8918-cac0-40cf-8a06-d507c0a37b58 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:50.675820 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-775a8918-cac0-40cf-8a06-d507c0a37b58 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:50.676770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-775a8918-cac0-40cf-8a06-d507c0a37b58 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:50.677252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-775a8918-cac0-40cf-8a06-d507c0a37b58 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:50.677689 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-775a8918-cac0-40cf-8a06-d507c0a37b58 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:50.814009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-775a8918-cac0-40cf-8a06-d507c0a37b58 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:50.822402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-775a8918-cac0-40cf-8a06-d507c0a37b58 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.160304 Sep 14 12:09:50.822974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 253/520] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:50 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:51.467658 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-0e594eb6-8c8a-4b97-bf0e-0daada22f017 req-b51a0fad-468a-488a-acff-c001d6cf537f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1", "name": "network-vif-plugged", "status": "completed", "tag": "027c61fc-efa6-4219-96b2-fd9ae33eb05c"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:51.477729 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-0e594eb6-8c8a-4b97-bf0e-0daada22f017 req-b51a0fad-468a-488a-acff-c001d6cf537f service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:51.478240 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-0e594eb6-8c8a-4b97-bf0e-0daada22f017 req-b51a0fad-468a-488a-acff-c001d6cf537f service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:51.478668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-0e594eb6-8c8a-4b97-bf0e-0daada22f017 req-b51a0fad-468a-488a-acff-c001d6cf537f service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:51.490047 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-0e594eb6-8c8a-4b97-bf0e-0daada22f017 req-b51a0fad-468a-488a-acff-c001d6cf537f service nova] Creating event network-vif-plugged:027c61fc-efa6-4219-96b2-fd9ae33eb05c for instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 on hv-cinder-84496 Sep 14 12:09:51.495086 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-0e594eb6-8c8a-4b97-bf0e-0daada22f017 req-b51a0fad-468a-488a-acff-c001d6cf537f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031102 Sep 14 12:09:51.495677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 268/521] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:09:51.674570 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7fc4052c-b02e-4633-9494-408589d2203f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:51.675212 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7fc4052c-b02e-4633-9494-408589d2203f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:51.681131 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fc4052c-b02e-4633-9494-408589d2203f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:51.681617 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fc4052c-b02e-4633-9494-408589d2203f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:51.682090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fc4052c-b02e-4633-9494-408589d2203f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:51.682782 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fc4052c-b02e-4633-9494-408589d2203f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:51.683282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fc4052c-b02e-4633-9494-408589d2203f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:51.683698 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fc4052c-b02e-4633-9494-408589d2203f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:51.829532 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7fc4052c-b02e-4633-9494-408589d2203f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:51.837733 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7fc4052c-b02e-4633-9494-408589d2203f tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1504 microversion: 2.1 time: 0.167199 Sep 14 12:09:51.838353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 254/522] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:51 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:51.845030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-975e93e1-4b98-43b9-82dd-07d389c3feba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:51.845745 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-975e93e1-4b98-43b9-82dd-07d389c3feba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:51.852020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-975e93e1-4b98-43b9-82dd-07d389c3feba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:51.852501 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-975e93e1-4b98-43b9-82dd-07d389c3feba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:51.852935 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-975e93e1-4b98-43b9-82dd-07d389c3feba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:51.853622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-975e93e1-4b98-43b9-82dd-07d389c3feba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:51.854108 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-975e93e1-4b98-43b9-82dd-07d389c3feba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:51.854534 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-975e93e1-4b98-43b9-82dd-07d389c3feba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:52.023804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-975e93e1-4b98-43b9-82dd-07d389c3feba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:52.031679 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-975e93e1-4b98-43b9-82dd-07d389c3feba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.190871 Sep 14 12:09:52.032262 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 269/523] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:51 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:52.866665 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a133492b-7bdc-459b-b978-09ea9c5a34d2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:52.867281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a133492b-7bdc-459b-b978-09ea9c5a34d2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:52.873759 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a133492b-7bdc-459b-b978-09ea9c5a34d2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:52.874285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a133492b-7bdc-459b-b978-09ea9c5a34d2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:52.874723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a133492b-7bdc-459b-b978-09ea9c5a34d2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:52.875411 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a133492b-7bdc-459b-b978-09ea9c5a34d2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:52.875869 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a133492b-7bdc-459b-b978-09ea9c5a34d2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:52.876297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a133492b-7bdc-459b-b978-09ea9c5a34d2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:53.055512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7b8390a8-33fe-402a-8386-1eb1475ec181 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:53.056296 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7b8390a8-33fe-402a-8386-1eb1475ec181 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:53.062574 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7b8390a8-33fe-402a-8386-1eb1475ec181 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:53.063176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7b8390a8-33fe-402a-8386-1eb1475ec181 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:53.063618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7b8390a8-33fe-402a-8386-1eb1475ec181 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:53.064319 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7b8390a8-33fe-402a-8386-1eb1475ec181 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:53.064771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7b8390a8-33fe-402a-8386-1eb1475ec181 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:53.065197 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7b8390a8-33fe-402a-8386-1eb1475ec181 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:53.069781 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:53.285687 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a133492b-7bdc-459b-b978-09ea9c5a34d2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:53.293670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a133492b-7bdc-459b-b978-09ea9c5a34d2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1504 microversion: 2.1 time: 0.431523 Sep 14 12:09:53.294363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 255/524] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:52 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:53.329595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7b8390a8-33fe-402a-8386-1eb1475ec181 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:53.337941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7b8390a8-33fe-402a-8386-1eb1475ec181 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.286232 Sep 14 12:09:53.338552 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 270/525] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:53 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:54.318568 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-022e5791-aadd-4c04-91dc-c03d1cfbd443 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:54.319315 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-022e5791-aadd-4c04-91dc-c03d1cfbd443 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:54.326366 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-022e5791-aadd-4c04-91dc-c03d1cfbd443 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:54.326873 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-022e5791-aadd-4c04-91dc-c03d1cfbd443 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:54.327314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-022e5791-aadd-4c04-91dc-c03d1cfbd443 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:54.328067 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-022e5791-aadd-4c04-91dc-c03d1cfbd443 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:54.328531 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-022e5791-aadd-4c04-91dc-c03d1cfbd443 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:54.328964 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-022e5791-aadd-4c04-91dc-c03d1cfbd443 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:54.361106 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9a812ad2-1d22-406e-a371-9c1443a1551e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:54.361746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9a812ad2-1d22-406e-a371-9c1443a1551e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:54.368131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a812ad2-1d22-406e-a371-9c1443a1551e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:54.368617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a812ad2-1d22-406e-a371-9c1443a1551e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:54.369050 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a812ad2-1d22-406e-a371-9c1443a1551e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:54.369740 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a812ad2-1d22-406e-a371-9c1443a1551e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:54.370219 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a812ad2-1d22-406e-a371-9c1443a1551e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:54.370642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a812ad2-1d22-406e-a371-9c1443a1551e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:54.651074 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-022e5791-aadd-4c04-91dc-c03d1cfbd443 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:54.658838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-022e5791-aadd-4c04-91dc-c03d1cfbd443 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1504 microversion: 2.1 time: 0.344654 Sep 14 12:09:54.659535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 256/526] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:54 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:54.661639 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9a812ad2-1d22-406e-a371-9c1443a1551e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:54.669495 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9a812ad2-1d22-406e-a371-9c1443a1551e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1370 microversion: 2.1 time: 0.312155 Sep 14 12:09:54.670484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 271/527] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:54 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:09:55.016274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-e5bebacd-071e-403a-9acc-7070b63e62c6 req-9c945f73-1764-4236-8b42-b595200662b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e08b9a-a9d4-482f-afcd-f9bef668d3dc", "name": "network-vif-deleted", "tag": "314aabb7-f4cc-43ed-abf5-fd778e2e2ac3"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:55.025849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-e5bebacd-071e-403a-9acc-7070b63e62c6 req-9c945f73-1764-4236-8b42-b595200662b1 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:55.026347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-e5bebacd-071e-403a-9acc-7070b63e62c6 req-9c945f73-1764-4236-8b42-b595200662b1 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:55.026772 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-e5bebacd-071e-403a-9acc-7070b63e62c6 req-9c945f73-1764-4236-8b42-b595200662b1 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:55.077178 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-e5bebacd-071e-403a-9acc-7070b63e62c6 req-9c945f73-1764-4236-8b42-b595200662b1 service nova] Creating event network-vif-deleted:314aabb7-f4cc-43ed-abf5-fd778e2e2ac3 for instance 48e08b9a-a9d4-482f-afcd-f9bef668d3dc on hv-cinder-84496 Sep 14 12:09:55.082280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-e5bebacd-071e-403a-9acc-7070b63e62c6 req-9c945f73-1764-4236-8b42-b595200662b1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069610 Sep 14 12:09:55.082880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 257/528] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:09:55.680892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2a98331e-0cc4-49fe-8138-f065ee34747c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:55.681534 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2a98331e-0cc4-49fe-8138-f065ee34747c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:55.687642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2a98331e-0cc4-49fe-8138-f065ee34747c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:55.688131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2a98331e-0cc4-49fe-8138-f065ee34747c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:55.688566 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2a98331e-0cc4-49fe-8138-f065ee34747c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:55.689250 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2a98331e-0cc4-49fe-8138-f065ee34747c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:55.689703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2a98331e-0cc4-49fe-8138-f065ee34747c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:55.690199 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2a98331e-0cc4-49fe-8138-f065ee34747c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:55.693324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0628503e-d2bb-460d-85a8-10647fa90865 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:55.694055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0628503e-d2bb-460d-85a8-10647fa90865 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:55.700362 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0628503e-d2bb-460d-85a8-10647fa90865 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:55.700844 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0628503e-d2bb-460d-85a8-10647fa90865 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:55.701279 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0628503e-d2bb-460d-85a8-10647fa90865 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:55.702001 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0628503e-d2bb-460d-85a8-10647fa90865 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:55.702455 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0628503e-d2bb-460d-85a8-10647fa90865 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:55.702875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0628503e-d2bb-460d-85a8-10647fa90865 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:55.756061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2a98331e-0cc4-49fe-8138-f065ee34747c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:55.764308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2a98331e-0cc4-49fe-8138-f065ee34747c tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1462 microversion: 2.1 time: 0.087353 Sep 14 12:09:55.764893 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 272/529] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:55 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:55.855168 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0628503e-d2bb-460d-85a8-10647fa90865 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:55.863004 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0628503e-d2bb-460d-85a8-10647fa90865 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1563 microversion: 2.1 time: 0.173864 Sep 14 12:09:55.863509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 258/530] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:55 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:55.890310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-721d94c1-df6b-44ea-ba0a-c16f4d239569 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:55.890791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-721d94c1-df6b-44ea-ba0a-c16f4d239569 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:55.897767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721d94c1-df6b-44ea-ba0a-c16f4d239569 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:55.898282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721d94c1-df6b-44ea-ba0a-c16f4d239569 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:55.898709 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721d94c1-df6b-44ea-ba0a-c16f4d239569 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:55.899394 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721d94c1-df6b-44ea-ba0a-c16f4d239569 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:55.900094 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721d94c1-df6b-44ea-ba0a-c16f4d239569 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:55.900508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721d94c1-df6b-44ea-ba0a-c16f4d239569 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:55.979275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-721d94c1-df6b-44ea-ba0a-c16f4d239569 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092890 Sep 14 12:09:55.979884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 273/531] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 14 12:09:55 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:09:56.789374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:56.790231 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:56.797784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:56.798309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:56.798750 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:56.799476 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:56.800504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:56.800932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:56.835831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:56.836573 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:56.837169 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:56.837813 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lazy-loading 'fault' on Instance uuid 48e08b9a-a9d4-482f-afcd-f9bef668d3dc {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:09:56.888702 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:56.897261 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-79e0282d-e4ba-4639-8816-27952fedf5a6 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1304 microversion: 2.1 time: 0.113208 Sep 14 12:09:56.898020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 259/532] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:56 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:57.097487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-6e6f7115-9c60-4bcc-a361-b6911485506f req-88e2f5cd-b183-4fb3-9e9f-d709862bcc67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1", "tag": "027c61fc-efa6-4219-96b2-fd9ae33eb05c"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:09:57.107467 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6e6f7115-9c60-4bcc-a361-b6911485506f req-88e2f5cd-b183-4fb3-9e9f-d709862bcc67 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:57.107953 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6e6f7115-9c60-4bcc-a361-b6911485506f req-88e2f5cd-b183-4fb3-9e9f-d709862bcc67 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:57.108382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6e6f7115-9c60-4bcc-a361-b6911485506f req-88e2f5cd-b183-4fb3-9e9f-d709862bcc67 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:57.120947 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-6e6f7115-9c60-4bcc-a361-b6911485506f req-88e2f5cd-b183-4fb3-9e9f-d709862bcc67 service nova] Creating event network-changed:027c61fc-efa6-4219-96b2-fd9ae33eb05c for instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 on hv-cinder-84496 Sep 14 12:09:57.128379 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-6e6f7115-9c60-4bcc-a361-b6911485506f req-88e2f5cd-b183-4fb3-9e9f-d709862bcc67 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034623 Sep 14 12:09:57.128901 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 274/533] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:09:57.923094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:57.923825 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:57.930863 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:57.932159 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:57.932644 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:57.933578 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:57.934298 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:57.934945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:57.976146 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:57.976754 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:57.977284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:57.978050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lazy-loading 'fault' on Instance uuid 48e08b9a-a9d4-482f-afcd-f9bef668d3dc {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:09:58.037033 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e133fb1749004c36a38ac028782294e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e692d812c3842608e10769277212d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:09:58.045592 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-507e12d1-30f7-4da9-b70e-64837a99bd09 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 200 len: 1304 microversion: 2.1 time: 0.126707 Sep 14 12:09:58.046752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 260/534] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:57 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:09:58.310632 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4361a1ae-40c8-4265-acf7-c980d06e52e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:58.311206 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4361a1ae-40c8-4265-acf7-c980d06e52e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:58.318116 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4361a1ae-40c8-4265-acf7-c980d06e52e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:58.318608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4361a1ae-40c8-4265-acf7-c980d06e52e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:58.319041 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4361a1ae-40c8-4265-acf7-c980d06e52e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:58.319724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4361a1ae-40c8-4265-acf7-c980d06e52e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:58.320174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4361a1ae-40c8-4265-acf7-c980d06e52e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:58.320595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4361a1ae-40c8-4265-acf7-c980d06e52e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:58.344345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4361a1ae-40c8-4265-acf7-c980d06e52e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/ips" status: 200 len: 152 microversion: 2.20 time: 0.038066 Sep 14 12:09:58.344913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 275/535] 10.222.0.62 () {60 vars in 1289 bytes} [Wed Sep 14 12:09:58 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:09:59.069118 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:09:59.069740 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] [instance: 48e08b9a-a9d4-482f-afcd-f9bef668d3dc] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:09:59.076382 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:59.076878 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:59.077320 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:59.078082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:09:59.078542 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:09:59.078973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:09:59.093466 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] HTTP exception thrown: Instance 48e08b9a-a9d4-482f-afcd-f9bef668d3dc could not be found. Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Request method failure captured: Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc HTTP/1.1 Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcQ5dpZE_4FZ8mcxQrjGsC8BIyHfw_M6fJsyiyxcq-q-jZVBzYHXrFa1IfwVnCyxEXraDd0HvXN3hDRazEQJYP9oUsseFFBfB_3M5vL3ssIph_xAvyCMNkldaWdXXg2AACa4LlUGvXfHOT8Dg19hxAWQ_DvShD-Cz_4XtXiPZn8JEyA Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 2e692d812c3842608e10769277212d85 Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-VolumesActionsTest-1504011276 Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:09:59.095386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2e692d812c3842608e10769277212d85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2e692d812c3842608e10769277212d85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2e692d812c3842608e10769277212d85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2e692d812c3842608e10769277212d85"}]}] Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-VolumesActionsTest-1504011276 Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 2e692d812c3842608e10769277212d85 Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-VolumesActionsTest-1504011276 Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-VolumesActionsTest-1504011276-project Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: e133fb1749004c36a38ac028782294e2 Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-VolumesActionsTest-1504011276-project Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 48e08b9a-a9d4-482f-afcd-f9bef668d3dc could not be found. Sep 14 12:09:59.097498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '48e08b9a-a9d4-482f-afcd-f9bef668d3dc'} Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e08b9a-a9d4-482f-afcd-f9bef668d3dc could not be found. Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:09:59.098584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e08b9a-a9d4-482f-afcd-f9bef668d3dc could not be found. Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e08b9a-a9d4-482f-afcd-f9bef668d3dc could not be found. Sep 14 12:09:59.100068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:09:59.101335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] Returning 404 to user: Instance 48e08b9a-a9d4-482f-afcd-f9bef668d3dc could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:09:59.101335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5da945ef-8e34-49c8-be2b-8381a7ad84f2 tempest-VolumesActionsTest-1504011276 tempest-VolumesActionsTest-1504011276-project] 10.222.0.62 "GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc" status: 404 len: 111 microversion: 2.1 time: 0.032425 Sep 14 12:09:59.102439 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 261/536] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:09:59 2022] GET /compute/v2.1/servers/48e08b9a-a9d4-482f-afcd-f9bef668d3dc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:10:01.742175 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c24b8317-2025-4c4b-a835-3865a9121da6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:10:01.742758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c24b8317-2025-4c4b-a835-3865a9121da6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:01.748945 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c24b8317-2025-4c4b-a835-3865a9121da6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:01.749431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c24b8317-2025-4c4b-a835-3865a9121da6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:01.749880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c24b8317-2025-4c4b-a835-3865a9121da6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:01.750581 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c24b8317-2025-4c4b-a835-3865a9121da6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:01.751064 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c24b8317-2025-4c4b-a835-3865a9121da6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:01.751461 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c24b8317-2025-4c4b-a835-3865a9121da6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:01.775949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-c24b8317-2025-4c4b-a835-3865a9121da6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lazy-loading 'flavor' on Instance uuid b7b1312a-8b45-4481-9a44-f330379d0c8f {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:10:02.330437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c24b8317-2025-4c4b-a835-3865a9121da6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "POST /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/action" status: 202 len: 0 microversion: 2.20 time: 0.592580 Sep 14 12:10:02.331557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 276/537] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Sep 14 12:10:01 2022] POST /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 14 12:10:02.341220 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:02.342683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:02.349976 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:02.350467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:02.351098 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:02.351804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:02.352298 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:02.352725 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:02.491751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:02.501069 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:02.502850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:02.509113 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6513dd32-71dd-4c54-8839-de24a57eea01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.167697 Sep 14 12:10:02.509113 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 262/538] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:02 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:03.530792 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:03.531495 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:03.540472 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:03.540959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:03.541395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:03.542178 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:03.542634 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:03.543055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:03.671591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:03.679597 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:03.681030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:03.682196 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-612b86e3-e931-4a6b-b6b4-9846ca66a415 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.155699 Sep 14 12:10:03.682745 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 277/539] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:03 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:04.706725 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:04.707268 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:04.713916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:04.714406 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:04.714841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:04.715521 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:04.715969 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:04.716388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:05.077421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:05.085589 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:05.087081 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:05.088284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c5e5763e-558e-405a-96d1-67a901ac03e0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.385499 Sep 14 12:10:05.088846 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 263/540] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:04 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:06.113949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:06.114553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:06.120965 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:06.121445 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:06.121879 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:06.122580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:06.123030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:06.123448 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:06.256182 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:06.264404 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:06.265839 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:06.267021 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e30c29ee-8b08-4efd-8e34-ac806946bc58 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.157269 Sep 14 12:10:06.267575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 278/541] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:06 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:07.292818 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:07.293428 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:07.295973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:07.301642 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:07.302198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:07.302644 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:07.303407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:07.303874 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:07.304345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:07.445596 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:07.453726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:07.455253 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:07.456946 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-46e3db6b-8cf4-4465-bc34-cf43a5554a9b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.167659 Sep 14 12:10:07.457503 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 264/542] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:07 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:08.483093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:08.483651 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:08.490119 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:08.490600 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:08.491029 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:08.491714 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:08.492163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:08.492627 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:08.630857 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:08.639081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:08.640622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:08.641771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b835a8cc-64c5-49cc-b88f-908431879e1e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.162776 Sep 14 12:10:08.642438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 279/543] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:08 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:09.671141 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:09.671897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:09.682870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:09.683762 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:09.684326 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:09.685079 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:09.685770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:09.686128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:09.836124 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:09.840405 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:09.845500 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:09.847006 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:09.852109 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1c16649c-3c44-42c2-9893-a5c8b1fac747 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.181112 Sep 14 12:10:09.852109 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 265/544] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:09 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:10.878053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:10.878882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:10.882181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=44 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:10.890581 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:10.891430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:10.891971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:10.892923 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:10.893528 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:10.894080 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:11.035240 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:11.043532 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:11.044962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:11.046149 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5e635357-9bf0-4717-8796-68afc33eb286 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.174141 Sep 14 12:10:11.046767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 280/545] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:10 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:12.071447 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:12.072684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:12.098161 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:12.102475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:12.104357 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:12.105877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:12.109995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:12.109995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:12.263897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:12.273523 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:12.275601 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:12.276851 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9d33e629-ce37-420b-b06f-3cfbdbbcc1bd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.209587 Sep 14 12:10:12.277424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 266/546] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:12 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:13.059273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-77bad5c7-736c-4c50-8e36-b5bd6095f809 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bef33f86-c9ab-4cf5-b2d6-8dd6cc3562ce", "device": "/dev/sdb"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:10:13.065496 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-77bad5c7-736c-4c50-8e36-b5bd6095f809 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:13.076295 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-77bad5c7-736c-4c50-8e36-b5bd6095f809 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:13.077548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-77bad5c7-736c-4c50-8e36-b5bd6095f809 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:13.078695 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-77bad5c7-736c-4c50-8e36-b5bd6095f809 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:13.080438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-77bad5c7-736c-4c50-8e36-b5bd6095f809 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:13.082136 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-77bad5c7-736c-4c50-8e36-b5bd6095f809 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:13.083207 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-77bad5c7-736c-4c50-8e36-b5bd6095f809 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:13.320227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:13.322230 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:13.333360 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:13.334234 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:13.335059 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:13.336214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:13.336955 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:13.337516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:13.501397 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:13.513995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:13.516453 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:13.517977 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b50d10c6-ab3b-4665-aab4-b3c3676d5096 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.204742 Sep 14 12:10:13.519426 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 267/547] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:13 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:14.547354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:14.549037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:14.557177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:14.558047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:14.558719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:14.559545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:14.560175 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:14.560610 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:14.719221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:14.736180 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:14.738588 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:14.740096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-debc02ac-c543-49ba-a922-f7ede49ba909 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.196976 Sep 14 12:10:14.755100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 268/548] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:14 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:15.768158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:15.769630 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:15.777154 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:15.778043 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:15.778697 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:15.779678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:15.780644 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:15.781398 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:15.943988 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:15.954275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:15.955861 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:15.957951 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-328a1f91-0cae-4e1e-b5b9-9ab84aeb6402 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.193674 Sep 14 12:10:15.974210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 269/549] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:15 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:16.984974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:16.985695 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:16.992823 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:16.993628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:16.994354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:16.995130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:16.995653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:16.996146 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:17.157472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:17.166863 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:17.168346 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:17.169626 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-82a6aaa1-e2c0-4491-9b92-5886322c82a7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.188879 Sep 14 12:10:17.186407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 270/550] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:16 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:17.953411 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-77bad5c7-736c-4c50-8e36-b5bd6095f809 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "POST /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.901864 Sep 14 12:10:17.954383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 281/551] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:10:13 2022] POST /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47/os-volume_attachments => generated 194 bytes in 4905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:10:18.197682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:18.198573 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:18.205527 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:18.206946 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:18.207094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:18.207877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:18.208329 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:18.209014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:18.373286 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:18.386472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:18.392080 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:18.396206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a501abd7-2b3b-49fe-9c37-7920e5233d53 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.201242 Sep 14 12:10:18.396879 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 271/552] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:18 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:19.425213 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:19.425988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:19.433512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:19.434047 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:19.439959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:19.439959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:19.439959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:19.439959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:19.583175 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:19.592289 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:19.593753 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:19.595074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-257285ef-2b8c-4ab3-ad26-c9056b159568 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.174974 Sep 14 12:10:19.595742 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 282/553] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:19 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:20.621257 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:20.622780 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:20.631191 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:20.631703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:20.632156 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:20.633006 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:20.633469 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:20.633965 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:20.785944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:20.795099 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:20.796611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:20.797894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-08797744-29eb-48fb-b1f2-6e859ff35adc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.180834 Sep 14 12:10:20.798695 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 272/554] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:20 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:21.838054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:21.838668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:21.846429 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:21.847565 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:21.848001 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:21.848727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:21.849200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:21.849614 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:22.025588 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:22.038153 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:22.041030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:22.042934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-95e506ca-493d-4740-be11-451a28ff8b9e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.208775 Sep 14 12:10:22.057886 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 283/555] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:21 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:23.081285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:23.082975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:23.090806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:23.092500 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:23.093600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:23.095411 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:23.096726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:23.097798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:23.249799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:23.259978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:23.261736 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:23.263038 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-467a05ae-8f8e-4a27-a9fc-8ac089c763fc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.186057 Sep 14 12:10:23.263618 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 273/556] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:23 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:24.304081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:24.304786 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:24.323149 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:24.324047 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:24.324632 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:24.325499 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:24.326239 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:24.326807 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:24.330646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:24.523825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:24.539861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:24.541724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:24.543466 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d6b44ee9-e78d-463a-8794-c7cc8ad2a91d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.255727 Sep 14 12:10:24.544156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 284/557] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:24 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:25.570180 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:25.570855 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:25.577661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:25.578096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:25.578547 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:25.579288 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:25.579949 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:25.580382 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:25.756031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:25.766830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:25.768633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:25.769832 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d30cec8c-dbca-46b3-8b57-511001d6ddb8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.203828 Sep 14 12:10:25.770582 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 274/558] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:25 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:26.797021 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:26.797646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:26.805650 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:26.806180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:26.806620 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:26.807344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:26.807801 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:26.808224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:26.991933 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:27.003221 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:27.005244 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:27.006769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-56a3da9b-aa8a-4fe7-aedb-76d1025bf75c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.214004 Sep 14 12:10:27.026448 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 285/559] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:26 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:28.037518 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:28.038471 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:28.048734 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:28.049840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:28.050671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:28.051894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:28.052688 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:28.053411 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:28.261546 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:28.278435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:28.281367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:28.283705 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-abd6b44c-27af-4766-95fb-a5a531be4f6e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.252729 Sep 14 12:10:28.285571 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 275/560] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:28 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:29.320249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:29.320854 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:29.327457 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:29.327936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:29.328373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:29.329062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:29.329509 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:29.329948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:29.471542 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:29.480294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:29.481975 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:29.483296 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-758f869c-e414-4088-89dd-c375a7afc1e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.167000 Sep 14 12:10:29.483700 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 286/561] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:29 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:30.508451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:30.508979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:30.515518 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:30.516011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:30.516454 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:30.517150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:30.517659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:30.518129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:30.650684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:30.658751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:30.660861 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:30.662074 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1dd043ed-0945-4aa9-b843-ff7b68436dd7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.157614 Sep 14 12:10:30.662641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 276/562] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:30 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:30.933641 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a506b3a9-4ec9-41f8-9230-bde359c74993 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:30.934243 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a506b3a9-4ec9-41f8-9230-bde359c74993 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:30.941280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a506b3a9-4ec9-41f8-9230-bde359c74993 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:30.941768 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a506b3a9-4ec9-41f8-9230-bde359c74993 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:30.942233 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a506b3a9-4ec9-41f8-9230-bde359c74993 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:30.942929 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a506b3a9-4ec9-41f8-9230-bde359c74993 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:30.943387 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a506b3a9-4ec9-41f8-9230-bde359c74993 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:30.949329 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a506b3a9-4ec9-41f8-9230-bde359c74993 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:30.966536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a506b3a9-4ec9-41f8-9230-bde359c74993 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/ips" status: 200 len: 146 microversion: 2.1 time: 0.036718 Sep 14 12:10:30.967103 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 287/563] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 14 12:10:30 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:10:31.692717 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:31.693935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:31.704661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:31.705493 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:31.706285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:31.707479 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:31.708267 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:31.709000 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:31.868053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:31.881286 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:31.882758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:31.883928 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e60b222d-cf5d-4c6d-b1e7-c3d6ba23c844 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.199177 Sep 14 12:10:31.884513 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 277/564] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:31 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:32.908966 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:32.910372 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:32.916846 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:32.917332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:32.917768 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:32.918490 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:32.918943 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:32.920318 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:33.052502 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:33.060552 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:33.062042 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:33.063190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-38ee97a6-155b-494f-9b01-3a609b8339e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.158490 Sep 14 12:10:33.063742 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 288/565] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:32 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:34.089078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:34.092309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:34.095396 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:34.095891 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:34.096330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:34.097517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:34.098003 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:34.098436 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:34.233730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:34.243353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:34.244841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:34.246064 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-38c814d1-a93e-4184-9a89-ab842c756e1c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.161822 Sep 14 12:10:34.246643 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 278/566] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:34 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:35.273049 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:35.273838 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:35.281088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:35.281572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:35.282042 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:35.282746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:35.283185 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:35.283601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:35.356029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-9e720b12-44c1-496b-97c5-d46c0d6eb34d req-e9f48b0b-ca4a-47fd-ac1d-5bc028ff8cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b1312a-8b45-4481-9a44-f330379d0c8f", "name": "network-vif-plugged", "status": "completed", "tag": "906fb0c9-14b7-4949-943a-c084b122ae8b"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:10:35.366416 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-9e720b12-44c1-496b-97c5-d46c0d6eb34d req-e9f48b0b-ca4a-47fd-ac1d-5bc028ff8cea service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:35.366900 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-9e720b12-44c1-496b-97c5-d46c0d6eb34d req-e9f48b0b-ca4a-47fd-ac1d-5bc028ff8cea service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:35.370136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-9e720b12-44c1-496b-97c5-d46c0d6eb34d req-e9f48b0b-ca4a-47fd-ac1d-5bc028ff8cea service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:35.379304 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-9e720b12-44c1-496b-97c5-d46c0d6eb34d req-e9f48b0b-ca4a-47fd-ac1d-5bc028ff8cea service nova] Creating event network-vif-plugged:906fb0c9-14b7-4949-943a-c084b122ae8b for instance b7b1312a-8b45-4481-9a44-f330379d0c8f on hv-cinder-84496 Sep 14 12:10:35.385045 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-9e720b12-44c1-496b-97c5-d46c0d6eb34d req-e9f48b0b-ca4a-47fd-ac1d-5bc028ff8cea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032765 Sep 14 12:10:35.385653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 279/567] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:10:35.445559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:35.460551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:35.463487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:35.464690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c6497b9c-9841-4e52-81b3-503a90991c22 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.196328 Sep 14 12:10:35.465253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 289/568] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:35 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:36.492448 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:36.493757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:36.500662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:36.501151 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:36.501588 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:36.502344 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:36.502797 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:36.503350 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:36.526865 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c98bb980-4f10-4739-832d-7414de70f0c1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73423d7f-9e8a-469a-9694-8bd0ba4884dc"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:10:36.529255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c98bb980-4f10-4739-832d-7414de70f0c1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:36.536738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c98bb980-4f10-4739-832d-7414de70f0c1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:36.537232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c98bb980-4f10-4739-832d-7414de70f0c1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:36.537922 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c98bb980-4f10-4739-832d-7414de70f0c1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:36.538582 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c98bb980-4f10-4739-832d-7414de70f0c1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:36.539216 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c98bb980-4f10-4739-832d-7414de70f0c1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:36.540199 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c98bb980-4f10-4739-832d-7414de70f0c1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:36.666079 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:36.674784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:36.682876 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:36.684142 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0bbbd00b-1d2e-48c1-9bea-8c2816107b12 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.197618 Sep 14 12:10:36.684752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 280/569] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:36 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:37.710559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:37.711205 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:37.713775 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=34 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:37.718484 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:37.718970 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:37.719436 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:37.720310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:37.720737 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:37.721211 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:37.867838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:37.876218 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:37.878310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:37.879667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a78b5c9f-d562-4d37-86c0-e7c2d138bfde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.173573 Sep 14 12:10:37.880241 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 281/570] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:37 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:38.421986 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c98bb980-4f10-4739-832d-7414de70f0c1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.899058 Sep 14 12:10:38.422658 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 290/571] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:10:36 2022] POST /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/os-volume_attachments => generated 194 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:10:38.905244 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:38.905852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:38.913068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:38.913559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:38.915692 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:38.915692 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:38.915692 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:38.915692 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:39.052177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:39.060216 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:39.061638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:39.062812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c827664b-961d-4cd3-a7f4-e810e5073fc2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.161582 Sep 14 12:10:39.063370 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 282/572] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:38 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:40.089173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:40.089897 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:40.096233 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:40.097253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:40.097691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:40.098518 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:40.098977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:40.099405 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:40.233739 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:40.242893 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:40.244356 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:40.245640 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e72825ae-8826-4443-9df5-cf30da49246c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.161375 Sep 14 12:10:40.246548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 291/573] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:40 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:41.270799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:41.271394 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:41.278324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:41.278809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:41.279243 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:41.280231 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:41.280771 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:41.281088 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:41.285354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:41.422258 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:41.435094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:41.437339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:41.438555 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1470e3fd-6690-4d2a-a253-01357e53a743 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.171704 Sep 14 12:10:41.439408 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 283/574] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:41 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:42.464734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:42.465466 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:42.467805 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=24 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:42.472614 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:42.473223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:42.473668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:42.474383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:42.474838 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:42.475265 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:42.623615 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:42.633814 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:42.637455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:42.637455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b6708baa-4685-4a54-9ea1-9ec30b3b963a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.175718 Sep 14 12:10:42.637455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 292/575] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:42 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:43.663174 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:43.663928 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:43.670765 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:43.671253 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:43.671690 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:43.672432 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:43.672889 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:43.673324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:43.815952 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:43.826641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:43.828101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:43.829293 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fba0bcbb-b53b-4218-8fd1-345a304c5bde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.170923 Sep 14 12:10:43.829883 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 284/576] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:43 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:44.858491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:44.859112 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:44.865851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:44.866994 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:44.866994 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:44.867913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:44.867913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:44.868527 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:45.004681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:45.013450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:45.014771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:45.017449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3d712199-54ff-4e39-bc27-55bcc67feaa0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.162943 Sep 14 12:10:45.018088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 293/577] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:44 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:46.044491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:46.045125 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:46.052694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:46.053184 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:46.053633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:46.054374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:46.054832 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:46.055286 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:46.193043 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:46.206865 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:46.210256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:46.212182 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ed6e5a75-97b0-48ec-b93e-6a254ad65c33 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.172073 Sep 14 12:10:46.213014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 285/578] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:46 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:47.240701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:47.241315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:47.248682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:47.249203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:47.249635 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:47.250363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:47.250811 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:47.251230 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:47.485698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:47.494455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:47.496536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:47.497704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ae2a319a-6bb1-4470-9566-f6fcd37f368b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.260959 Sep 14 12:10:47.498292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 294/579] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:47 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:48.523401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:48.524038 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:48.530880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:48.531360 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:48.531793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:48.532484 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:48.532931 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:48.533353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:48.678190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:48.687430 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:48.688870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:48.690151 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6fd80448-6c21-4f37-b416-b97ada1ff26d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.170903 Sep 14 12:10:48.690743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 286/580] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:48 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:49.717717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:49.718377 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:49.725378 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:49.725874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:49.726317 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:49.727005 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:49.727450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:49.727903 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:49.870313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:49.878599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:49.880588 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:49.881720 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-fcb3c002-64da-4762-98a5-0e2990c3b782 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.168113 Sep 14 12:10:49.882304 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 295/581] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:49 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:50.906985 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:50.907586 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:50.914827 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:50.917661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:50.917661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:50.917661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:50.917661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:50.918086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:51.053696 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:51.062064 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:51.064536 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:51.065686 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-83040e24-904d-425c-8b4e-c0b467aeef4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.162620 Sep 14 12:10:51.066287 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 287/582] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:50 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:52.094968 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:52.095977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:52.107422 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:52.108230 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:52.108962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:52.111395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:52.111395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:52.112618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:52.258782 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:52.273353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:52.276776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:52.279433 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0e754e71-8bc9-41de-8de1-e37023f1a80f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1744 microversion: 2.20 time: 0.190670 Sep 14 12:10:52.280427 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 296/583] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:52 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:53.308493 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:53.309134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:53.315646 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:53.316229 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:53.316674 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:53.317504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:53.317993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:53.318428 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:53.459108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:53.467292 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:53.468729 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:53.469916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f0b7406c-10b7-46eb-83fe-ccf15efe4369 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.165397 Sep 14 12:10:53.470478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 288/584] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:53 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:54.496905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:54.497547 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:54.503950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:54.505012 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:54.505450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:54.506347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:54.506806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:54.507231 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:54.513075 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:54.808789 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:54.817726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:54.819264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:54.823706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-effdb0ca-2945-498f-9a74-e7104442ad26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.328439 Sep 14 12:10:54.823706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 297/585] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:54 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:55.592203 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c0831454-5931-44b8-b242-c45a988c36c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:10:55.599670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0831454-5931-44b8-b242-c45a988c36c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:55.600350 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0831454-5931-44b8-b242-c45a988c36c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:55.600801 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0831454-5931-44b8-b242-c45a988c36c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:55.668730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c0831454-5931-44b8-b242-c45a988c36c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Going to try to stop instance {{(pid=121153) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 12:10:55.846684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:55.847435 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:55.854813 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:55.857773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:55.857773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:55.857773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:55.857773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:55.858129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:55.888468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c0831454-5931-44b8-b242-c45a988c36c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/action" status: 202 len: 0 microversion: 2.1 time: 0.299404 Sep 14 12:10:55.889403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 289/586] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:10:55 2022] POST /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:10:55.899179 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-45372e87-85d6-40a4-899f-77a67df18f8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:55.900561 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-45372e87-85d6-40a4-899f-77a67df18f8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:55.922708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-45372e87-85d6-40a4-899f-77a67df18f8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:55.923498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-45372e87-85d6-40a4-899f-77a67df18f8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:55.924124 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-45372e87-85d6-40a4-899f-77a67df18f8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:55.925021 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-45372e87-85d6-40a4-899f-77a67df18f8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:55.925727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-45372e87-85d6-40a4-899f-77a67df18f8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:55.926345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-45372e87-85d6-40a4-899f-77a67df18f8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:56.059449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:56.070501 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:56.072883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:56.074375 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0b8a8b58-2d53-45e1-8c1c-44d286247973 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.232669 Sep 14 12:10:56.075556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 298/587] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:55 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:56.178307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-45372e87-85d6-40a4-899f-77a67df18f8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:56.188673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-45372e87-85d6-40a4-899f-77a67df18f8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.294216 Sep 14 12:10:56.189245 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 290/588] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:10:55 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:10:57.101004 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:57.101562 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:57.108366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:57.108855 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:57.109499 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:57.110114 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:57.110569 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:57.110993 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:57.213335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7781b140-8348-4ec2-8eb1-9858fb77054a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:57.219874 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7781b140-8348-4ec2-8eb1-9858fb77054a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:57.222242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7781b140-8348-4ec2-8eb1-9858fb77054a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:57.223403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7781b140-8348-4ec2-8eb1-9858fb77054a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:57.223949 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7781b140-8348-4ec2-8eb1-9858fb77054a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:57.224739 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7781b140-8348-4ec2-8eb1-9858fb77054a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:57.225285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7781b140-8348-4ec2-8eb1-9858fb77054a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:57.225787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7781b140-8348-4ec2-8eb1-9858fb77054a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:57.292021 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:57.305563 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:57.307229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:57.310161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ef206b66-bb5a-487d-ad88-54220a9cfb30 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.211809 Sep 14 12:10:57.311088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 299/589] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:57 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:57.400759 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7781b140-8348-4ec2-8eb1-9858fb77054a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:57.410890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7781b140-8348-4ec2-8eb1-9858fb77054a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.201083 Sep 14 12:10:57.411458 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 291/590] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:10:57 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:10:57.733934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-47a7ba60-9159-42e4-8d4e-a8dfd30784fa tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:57.734830 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-47a7ba60-9159-42e4-8d4e-a8dfd30784fa tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:57.743362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47a7ba60-9159-42e4-8d4e-a8dfd30784fa tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:57.743920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47a7ba60-9159-42e4-8d4e-a8dfd30784fa tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:57.744542 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47a7ba60-9159-42e4-8d4e-a8dfd30784fa tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:57.746060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47a7ba60-9159-42e4-8d4e-a8dfd30784fa tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:57.746843 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47a7ba60-9159-42e4-8d4e-a8dfd30784fa tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:57.747325 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47a7ba60-9159-42e4-8d4e-a8dfd30784fa tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:57.925117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-47a7ba60-9159-42e4-8d4e-a8dfd30784fa tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lazy-loading 'services' on Instance uuid 991ad790-ed34-4f78-9db4-91ad889c3c47 {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:10:58.337148 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:58.337713 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:58.344277 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:58.345269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:58.345705 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:58.346443 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:58.347111 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:58.347452 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:58.423615 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-47a7ba60-9159-42e4-8d4e-a8dfd30784fa tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "DELETE /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47/os-volume_attachments/bef33f86-c9ab-4cf5-b2d6-8dd6cc3562ce" status: 202 len: 0 microversion: 2.1 time: 0.693536 Sep 14 12:10:58.424355 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 300/591] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:10:57 2022] DELETE /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47/os-volume_attachments/bef33f86-c9ab-4cf5-b2d6-8dd6cc3562ce => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:10:58.439121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ae01e413-80a6-44ce-b6b6-4760af0b8760 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:58.441294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ae01e413-80a6-44ce-b6b6-4760af0b8760 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:58.457764 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae01e413-80a6-44ce-b6b6-4760af0b8760 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:58.458974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae01e413-80a6-44ce-b6b6-4760af0b8760 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:58.459946 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae01e413-80a6-44ce-b6b6-4760af0b8760 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:58.460767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae01e413-80a6-44ce-b6b6-4760af0b8760 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:58.461821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae01e413-80a6-44ce-b6b6-4760af0b8760 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:58.461821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ae01e413-80a6-44ce-b6b6-4760af0b8760 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:58.494405 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:58.503101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:58.504548 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:58.505713 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7cad034d-2f33-4774-b421-76a614aa05cb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.172617 Sep 14 12:10:58.506509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 292/592] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:58 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:10:58.629624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ae01e413-80a6-44ce-b6b6-4760af0b8760 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:58.653041 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ae01e413-80a6-44ce-b6b6-4760af0b8760 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.219365 Sep 14 12:10:58.654331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 301/593] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:10:58 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:10:59.536535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:59.538190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:59.545506 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:59.546728 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:59.546728 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:59.547604 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:59.548184 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:59.548840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:59.679532 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-38a5c255-18d6-48c8-95a9-7f4cf138aa90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:10:59.680843 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-38a5c255-18d6-48c8-95a9-7f4cf138aa90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:10:59.687847 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38a5c255-18d6-48c8-95a9-7f4cf138aa90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:59.688892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38a5c255-18d6-48c8-95a9-7f4cf138aa90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:59.689607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38a5c255-18d6-48c8-95a9-7f4cf138aa90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:59.690426 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38a5c255-18d6-48c8-95a9-7f4cf138aa90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:10:59.691735 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38a5c255-18d6-48c8-95a9-7f4cf138aa90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:10:59.692169 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38a5c255-18d6-48c8-95a9-7f4cf138aa90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:10:59.721618 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:59.735852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:59.739116 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:59.741556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0608b644-7ac1-4843-b8c0-0741ba060098 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.209232 Sep 14 12:10:59.759893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 293/594] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:10:59 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:10:59.868205 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-38a5c255-18d6-48c8-95a9-7f4cf138aa90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:10:59.878120 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-38a5c255-18d6-48c8-95a9-7f4cf138aa90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.203454 Sep 14 12:10:59.878836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 302/595] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:10:59 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:00.703954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-39a00f38-ea20-4cea-a3eb-8148178b2210 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:00.710668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-39a00f38-ea20-4cea-a3eb-8148178b2210 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:00.711807 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a00f38-ea20-4cea-a3eb-8148178b2210 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:00.712301 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a00f38-ea20-4cea-a3eb-8148178b2210 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:00.713023 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a00f38-ea20-4cea-a3eb-8148178b2210 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:00.713729 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a00f38-ea20-4cea-a3eb-8148178b2210 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:00.714205 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a00f38-ea20-4cea-a3eb-8148178b2210 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:00.714620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-39a00f38-ea20-4cea-a3eb-8148178b2210 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:00.746058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-39a00f38-ea20-4cea-a3eb-8148178b2210 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:11:00.769243 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:00.770575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:00.784792 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:00.785366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:00.786421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:00.789357 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:00.790579 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:00.791312 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:00.957301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:00.966364 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:00.975588 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:00.975588 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ef9ab863-ba6e-4cad-84aa-1a525c950f02 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.211278 Sep 14 12:11:00.977936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 303/596] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:00 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:00.982551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-45e9ce9d-7518-4125-8a2d-b6807996723b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:00.989402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-45e9ce9d-7518-4125-8a2d-b6807996723b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:01.000570 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45e9ce9d-7518-4125-8a2d-b6807996723b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:01.001064 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45e9ce9d-7518-4125-8a2d-b6807996723b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:01.001485 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45e9ce9d-7518-4125-8a2d-b6807996723b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:01.006338 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45e9ce9d-7518-4125-8a2d-b6807996723b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:01.007245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45e9ce9d-7518-4125-8a2d-b6807996723b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:01.007921 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45e9ce9d-7518-4125-8a2d-b6807996723b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:01.180590 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-39a00f38-ea20-4cea-a3eb-8148178b2210 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "DELETE /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 204 len: 0 microversion: 2.1 time: 0.480742 Sep 14 12:11:01.181281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 294/597] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:11:00 2022] DELETE /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:11:01.193181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b1e6b0f3-4585-4a0f-86c8-65dcfcbd815b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:01.194664 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b1e6b0f3-4585-4a0f-86c8-65dcfcbd815b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:01.209199 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1e6b0f3-4585-4a0f-86c8-65dcfcbd815b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:01.216421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1e6b0f3-4585-4a0f-86c8-65dcfcbd815b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:01.216421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1e6b0f3-4585-4a0f-86c8-65dcfcbd815b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:01.216421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1e6b0f3-4585-4a0f-86c8-65dcfcbd815b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:01.216421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1e6b0f3-4585-4a0f-86c8-65dcfcbd815b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:01.216777 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1e6b0f3-4585-4a0f-86c8-65dcfcbd815b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:01.261903 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-45e9ce9d-7518-4125-8a2d-b6807996723b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:01.279531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-45e9ce9d-7518-4125-8a2d-b6807996723b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.302798 Sep 14 12:11:01.280297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 304/598] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:00 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:01.407732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b1e6b0f3-4585-4a0f-86c8-65dcfcbd815b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:01.420579 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b1e6b0f3-4585-4a0f-86c8-65dcfcbd815b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1513 microversion: 2.1 time: 0.234077 Sep 14 12:11:01.421101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 295/599] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:01 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:02.005276 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:02.005962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:02.012976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:02.013511 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:02.014193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:02.014959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:02.016305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:02.016305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:02.148889 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:02.162949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:02.164998 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:02.166778 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f742b20e-556f-4853-adfc-f39cd33741e7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.165790 Sep 14 12:11:02.167793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 305/600] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:01 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:02.304468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-87547909-7890-41c7-974b-cecc70dff923 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:02.305108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-87547909-7890-41c7-974b-cecc70dff923 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:02.313136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87547909-7890-41c7-974b-cecc70dff923 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:02.313632 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87547909-7890-41c7-974b-cecc70dff923 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:02.314149 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87547909-7890-41c7-974b-cecc70dff923 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:02.314886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87547909-7890-41c7-974b-cecc70dff923 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:02.315369 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87547909-7890-41c7-974b-cecc70dff923 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:02.315807 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87547909-7890-41c7-974b-cecc70dff923 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:02.445691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6bb9a632-dca5-442f-8847-bc709a7f6577 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:02.446490 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6bb9a632-dca5-442f-8847-bc709a7f6577 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:02.453011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bb9a632-dca5-442f-8847-bc709a7f6577 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:02.453734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bb9a632-dca5-442f-8847-bc709a7f6577 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:02.453975 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bb9a632-dca5-442f-8847-bc709a7f6577 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:02.454683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bb9a632-dca5-442f-8847-bc709a7f6577 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:02.455259 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bb9a632-dca5-442f-8847-bc709a7f6577 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:02.460577 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bb9a632-dca5-442f-8847-bc709a7f6577 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:02.462954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-87547909-7890-41c7-974b-cecc70dff923 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:02.473705 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-87547909-7890-41c7-974b-cecc70dff923 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.173934 Sep 14 12:11:02.475499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 296/601] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:02 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:02.597241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6bb9a632-dca5-442f-8847-bc709a7f6577 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:02.605834 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6bb9a632-dca5-442f-8847-bc709a7f6577 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1513 microversion: 2.1 time: 0.164901 Sep 14 12:11:02.607037 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 306/602] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:02 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:11:03.204531 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:03.205166 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:03.219448 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:03.219931 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:03.220475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:03.221465 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:03.227697 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:03.228304 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:03.234068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:03.489831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:03.501392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e087e5b3-2a6a-456a-abe1-44a13358fac8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:03.503087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e087e5b3-2a6a-456a-abe1-44a13358fac8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:03.517297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e087e5b3-2a6a-456a-abe1-44a13358fac8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:03.518470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e087e5b3-2a6a-456a-abe1-44a13358fac8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:03.518917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:03.519512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e087e5b3-2a6a-456a-abe1-44a13358fac8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:03.520589 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:03.521084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e087e5b3-2a6a-456a-abe1-44a13358fac8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:03.522408 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-82056a38-3488-4b76-b48e-adb25d04b6cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.322210 Sep 14 12:11:03.523319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 297/603] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:03 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:03.523646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e087e5b3-2a6a-456a-abe1-44a13358fac8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:03.525094 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e087e5b3-2a6a-456a-abe1-44a13358fac8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:03.630037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-351cc503-714a-4643-af5d-35accaf6d69f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:03.632068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-351cc503-714a-4643-af5d-35accaf6d69f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:03.641497 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-351cc503-714a-4643-af5d-35accaf6d69f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:03.642902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-351cc503-714a-4643-af5d-35accaf6d69f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:03.645081 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-351cc503-714a-4643-af5d-35accaf6d69f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:03.646634 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-351cc503-714a-4643-af5d-35accaf6d69f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:03.647734 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-351cc503-714a-4643-af5d-35accaf6d69f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:03.648408 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-351cc503-714a-4643-af5d-35accaf6d69f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:03.733537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e087e5b3-2a6a-456a-abe1-44a13358fac8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:03.748681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e087e5b3-2a6a-456a-abe1-44a13358fac8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.248492 Sep 14 12:11:03.764846 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 307/604] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:03 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:03.832859 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-351cc503-714a-4643-af5d-35accaf6d69f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:03.843981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-351cc503-714a-4643-af5d-35accaf6d69f tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1513 microversion: 2.1 time: 0.218984 Sep 14 12:11:03.845524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 298/605] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:03 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:04.556162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:04.557078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:04.566785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:04.567616 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:04.568426 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:04.570470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:04.571535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:04.572594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:04.700927 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-7cf845f8-1703-4903-bf36-08e26b78b516 req-231e9742-fcc1-47b1-b9b3-7bfced64dcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991ad790-ed34-4f78-9db4-91ad889c3c47", "name": "network-vif-deleted", "tag": "de246217-d047-4d75-a069-3f9ac78fe2d2"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:11:04.712853 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7cf845f8-1703-4903-bf36-08e26b78b516 req-231e9742-fcc1-47b1-b9b3-7bfced64dcf7 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:04.714499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7cf845f8-1703-4903-bf36-08e26b78b516 req-231e9742-fcc1-47b1-b9b3-7bfced64dcf7 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:04.715020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-7cf845f8-1703-4903-bf36-08e26b78b516 req-231e9742-fcc1-47b1-b9b3-7bfced64dcf7 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:04.730656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-7cf845f8-1703-4903-bf36-08e26b78b516 req-231e9742-fcc1-47b1-b9b3-7bfced64dcf7 service nova] Creating event network-vif-deleted:de246217-d047-4d75-a069-3f9ac78fe2d2 for instance 991ad790-ed34-4f78-9db4-91ad889c3c47 on hv-cinder-84496 Sep 14 12:11:04.737126 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-7cf845f8-1703-4903-bf36-08e26b78b516 req-231e9742-fcc1-47b1-b9b3-7bfced64dcf7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046275 Sep 14 12:11:04.744030 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 299/606] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:11:04.776694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bdd7e58c-e623-4756-a24f-e2c5655da442 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:04.777744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bdd7e58c-e623-4756-a24f-e2c5655da442 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:04.798260 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bdd7e58c-e623-4756-a24f-e2c5655da442 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:04.800360 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bdd7e58c-e623-4756-a24f-e2c5655da442 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:04.800881 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bdd7e58c-e623-4756-a24f-e2c5655da442 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:04.801796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bdd7e58c-e623-4756-a24f-e2c5655da442 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:04.803185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bdd7e58c-e623-4756-a24f-e2c5655da442 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:04.803696 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bdd7e58c-e623-4756-a24f-e2c5655da442 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:04.807332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:04.821446 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:04.826477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:04.832053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-450d545c-2d07-44fb-8d8c-2a2ff3cd53cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.274765 Sep 14 12:11:04.846437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 308/607] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:04 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:04.869280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-25681676-a28c-4b23-8062-d614738fddfc tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:04.870510 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-25681676-a28c-4b23-8062-d614738fddfc tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:04.882580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25681676-a28c-4b23-8062-d614738fddfc tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:04.883448 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25681676-a28c-4b23-8062-d614738fddfc tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:04.884076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25681676-a28c-4b23-8062-d614738fddfc tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:04.884954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25681676-a28c-4b23-8062-d614738fddfc tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:04.885609 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25681676-a28c-4b23-8062-d614738fddfc tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:04.886235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25681676-a28c-4b23-8062-d614738fddfc tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:04.981489 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-25681676-a28c-4b23-8062-d614738fddfc tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:04.992681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-25681676-a28c-4b23-8062-d614738fddfc tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1303 microversion: 2.1 time: 0.128652 Sep 14 12:11:04.993963 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 309/608] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:04 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:05.014702 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bdd7e58c-e623-4756-a24f-e2c5655da442 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:05.024996 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bdd7e58c-e623-4756-a24f-e2c5655da442 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.253640 Sep 14 12:11:05.031567 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 300/609] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:04 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:05.861296 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:05.861941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:05.868395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:05.868883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:05.869366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:05.870103 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:05.870557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:05.870981 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:06.012174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:06.018582 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:06.019335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:06.020860 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:06.022327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:06.023553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0354be72-df4a-443a-91c3-4a4ec43c9abe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.166207 Sep 14 12:11:06.024530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 310/610] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:05 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:06.026287 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:06.026782 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:06.027221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:06.027924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:06.028379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:06.028803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:06.048698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-970584d7-3c16-4e0a-bab8-2a6c2b7f4057 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:06.049310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-970584d7-3c16-4e0a-bab8-2a6c2b7f4057 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:06.055961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-970584d7-3c16-4e0a-bab8-2a6c2b7f4057 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:06.056455 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-970584d7-3c16-4e0a-bab8-2a6c2b7f4057 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:06.056893 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-970584d7-3c16-4e0a-bab8-2a6c2b7f4057 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:06.057589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-970584d7-3c16-4e0a-bab8-2a6c2b7f4057 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:06.058080 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-970584d7-3c16-4e0a-bab8-2a6c2b7f4057 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:06.058511 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-970584d7-3c16-4e0a-bab8-2a6c2b7f4057 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:06.059931 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:06.060296 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:06.060731 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:06.061254 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lazy-loading 'fault' on Instance uuid 991ad790-ed34-4f78-9db4-91ad889c3c47 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:11:06.116784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:06.124776 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4e52ef78-f707-4952-bd23-d249dc8d0ff0 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 200 len: 1308 microversion: 2.1 time: 0.109908 Sep 14 12:11:06.126193 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 301/611] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:06 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:11:06.236362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-970584d7-3c16-4e0a-bab8-2a6c2b7f4057 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:06.246482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-970584d7-3c16-4e0a-bab8-2a6c2b7f4057 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.201685 Sep 14 12:11:06.262447 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 311/612] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:06 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:07.049624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:07.050266 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:07.057182 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:07.057671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:07.058139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:07.058830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:07.059286 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:07.059711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:07.148711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:07.149403 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: 991ad790-ed34-4f78-9db4-91ad889c3c47] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:07.157306 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:07.157815 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:07.158514 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:07.159222 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:07.159677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:07.160096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:07.174554 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] HTTP exception thrown: Instance 991ad790-ed34-4f78-9db4-91ad889c3c47 could not be found. Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Request method failure captured: Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 HTTP/1.1 Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcRDam_B3cGv6YC9dKVpW4P0kmPIIiFlnb8buXemlMunpM3IED6Nq_e9i-I-ck_IxbvbHQtj2jg4JMqZ2uaE4xeFy1SrAnGPvbbU22HjiZj-2KkNzmSCmFKP8ONtnU42-cbxXeeQF9JheswZXWDic5WHqd_G2nGEo6izlepBBNkrfPg Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 1488f00baa934f2e9b910644a179c755 Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1737726883 Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:11:07.176246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1488f00baa934f2e9b910644a179c755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1488f00baa934f2e9b910644a179c755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1488f00baa934f2e9b910644a179c755"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1488f00baa934f2e9b910644a179c755"}]}] Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesSnapshotTestJSON-1737726883 Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 1488f00baa934f2e9b910644a179c755 Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1737726883 Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesSnapshotTestJSON-1737726883-project Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 8fe575351bdc456682db592f0c723ea6 Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesSnapshotTestJSON-1737726883-project Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 991ad790-ed34-4f78-9db4-91ad889c3c47 could not be found. Sep 14 12:11:07.181392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '991ad790-ed34-4f78-9db4-91ad889c3c47'} Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991ad790-ed34-4f78-9db4-91ad889c3c47 could not be found. Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:11:07.182359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991ad790-ed34-4f78-9db4-91ad889c3c47 could not be found. Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991ad790-ed34-4f78-9db4-91ad889c3c47 could not be found. Sep 14 12:11:07.183580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:11:07.184693 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Returning 404 to user: Instance 991ad790-ed34-4f78-9db4-91ad889c3c47 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:11:07.184693 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-fefdaf3c-2a60-49b1-8fe7-cdd1bc231d21 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47" status: 404 len: 111 microversion: 2.1 time: 0.033601 Sep 14 12:11:07.184693 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 312/613] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:07 2022] GET /compute/v2.1/servers/991ad790-ed34-4f78-9db4-91ad889c3c47 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:11:07.196279 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:07.218280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:07.219729 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:07.220904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8773a6f0-4147-4091-a247-ea3dbde9b254 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1739 microversion: 2.20 time: 0.175256 Sep 14 12:11:07.221466 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 302/614] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:07 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:07.272598 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a8c9a696-55f3-4571-97ca-9a01c52d0e33 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:07.273206 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a8c9a696-55f3-4571-97ca-9a01c52d0e33 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:07.279331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8c9a696-55f3-4571-97ca-9a01c52d0e33 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:07.284345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8c9a696-55f3-4571-97ca-9a01c52d0e33 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:07.284345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8c9a696-55f3-4571-97ca-9a01c52d0e33 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:07.284345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8c9a696-55f3-4571-97ca-9a01c52d0e33 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:07.284345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8c9a696-55f3-4571-97ca-9a01c52d0e33 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:07.284862 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a8c9a696-55f3-4571-97ca-9a01c52d0e33 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:07.413938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a8c9a696-55f3-4571-97ca-9a01c52d0e33 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:07.416215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:07.422788 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a8c9a696-55f3-4571-97ca-9a01c52d0e33 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.154330 Sep 14 12:11:07.423356 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 313/615] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:07 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:08.349642 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:08.350284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:08.352402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:08.357053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:08.357542 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:08.358000 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:08.358729 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:08.359175 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:08.359595 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:08.447222 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9e3bcad3-9d84-42a7-a56d-50796adf42dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:08.447948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9e3bcad3-9d84-42a7-a56d-50796adf42dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:08.455018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e3bcad3-9d84-42a7-a56d-50796adf42dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:08.455515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e3bcad3-9d84-42a7-a56d-50796adf42dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:08.455951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e3bcad3-9d84-42a7-a56d-50796adf42dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:08.456652 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e3bcad3-9d84-42a7-a56d-50796adf42dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:08.457104 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e3bcad3-9d84-42a7-a56d-50796adf42dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:08.457526 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e3bcad3-9d84-42a7-a56d-50796adf42dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:08.494521 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:08.502856 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:08.504217 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:08.505422 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6d363d4f-a9d7-4307-b09d-cd9eb36af4af tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1721 microversion: 2.20 time: 0.261165 Sep 14 12:11:08.517885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 303/616] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:08 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:08.819016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9e3bcad3-9d84-42a7-a56d-50796adf42dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:08.827278 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9e3bcad3-9d84-42a7-a56d-50796adf42dc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.384995 Sep 14 12:11:08.827858 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 314/617] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:08 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:11:09.530988 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:09.531584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:09.538514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:09.539005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:09.539451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:09.540151 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:09.540610 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:09.541042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:09.670703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:09.679977 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:09.681613 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:09.682699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c0820ca7-9261-4238-a8d1-9ba10ea14cde tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1721 microversion: 2.20 time: 0.155645 Sep 14 12:11:09.683526 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 304/618] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:09 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:09.852194 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a5d42e38-aff2-4a8c-8bf2-91ec11b2de82 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:09.852863 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a5d42e38-aff2-4a8c-8bf2-91ec11b2de82 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:09.859225 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a5d42e38-aff2-4a8c-8bf2-91ec11b2de82 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:09.859710 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a5d42e38-aff2-4a8c-8bf2-91ec11b2de82 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:09.860144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a5d42e38-aff2-4a8c-8bf2-91ec11b2de82 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:09.860835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a5d42e38-aff2-4a8c-8bf2-91ec11b2de82 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:09.861286 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a5d42e38-aff2-4a8c-8bf2-91ec11b2de82 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:09.861747 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a5d42e38-aff2-4a8c-8bf2-91ec11b2de82 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:09.994179 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a5d42e38-aff2-4a8c-8bf2-91ec11b2de82 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:10.002359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a5d42e38-aff2-4a8c-8bf2-91ec11b2de82 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.154868 Sep 14 12:11:10.002927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 315/619] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:09 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:10.707680 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:10.708286 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:10.711237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 12:11:10.711388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Wed Sep 14 12:11:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f (ip 10.222.0.62) !!! Sep 14 12:11:10.723833 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:10.724351 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:10.724785 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:10.725544 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:10.725956 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:10.726383 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:10.856823 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:10.865769 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:10.867430 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:10.868591 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c28c93b0-bd36-4295-bf9a-1210f3539f8d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1721 microversion: 2.20 time: 0.165036 Sep 14 12:11:10.869150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 305/620] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:10 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:11.024557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f0530b76-c431-47af-a302-3391dd58c543 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:11.025373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f0530b76-c431-47af-a302-3391dd58c543 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:11.031887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0530b76-c431-47af-a302-3391dd58c543 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:11.032375 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0530b76-c431-47af-a302-3391dd58c543 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:11.032820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0530b76-c431-47af-a302-3391dd58c543 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:11.033515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0530b76-c431-47af-a302-3391dd58c543 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:11.034003 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0530b76-c431-47af-a302-3391dd58c543 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:11.034430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0530b76-c431-47af-a302-3391dd58c543 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:11.164202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f0530b76-c431-47af-a302-3391dd58c543 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:11.172549 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f0530b76-c431-47af-a302-3391dd58c543 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.151893 Sep 14 12:11:11.173151 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 316/621] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:11 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:11.894135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:11.894738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:11.902222 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:11.902710 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:11.903140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:11.903830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:11.904277 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:11.904697 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:12.034573 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:12.042602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:12.044045 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:12.045197 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fe795aaf-f98a-4e3d-a8fb-50f3ee52de09 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1721 microversion: 2.20 time: 0.155139 Sep 14 12:11:12.045754 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 306/622] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:11 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:12.320830 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e23397df-7b6a-4f65-a7db-14b08d5a9ea1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:12.321458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e23397df-7b6a-4f65-a7db-14b08d5a9ea1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:12.328573 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e23397df-7b6a-4f65-a7db-14b08d5a9ea1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:12.329556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e23397df-7b6a-4f65-a7db-14b08d5a9ea1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:12.329837 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e23397df-7b6a-4f65-a7db-14b08d5a9ea1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:12.330621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e23397df-7b6a-4f65-a7db-14b08d5a9ea1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:12.331086 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e23397df-7b6a-4f65-a7db-14b08d5a9ea1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:12.331515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e23397df-7b6a-4f65-a7db-14b08d5a9ea1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:12.470493 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e23397df-7b6a-4f65-a7db-14b08d5a9ea1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:12.492490 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e23397df-7b6a-4f65-a7db-14b08d5a9ea1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1724 microversion: 2.1 time: 0.287767 Sep 14 12:11:12.493482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 317/623] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:12 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:12.495706 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-5a035408-c0f4-47d3-b239-3a88eb3b9e84 req-b1f6609b-fe0a-4943-99a5-fd0cf3077c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b1312a-8b45-4481-9a44-f330379d0c8f", "name": "network-vif-unplugged", "status": "completed", "tag": "906fb0c9-14b7-4949-943a-c084b122ae8b"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:11:12.506910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-5a035408-c0f4-47d3-b239-3a88eb3b9e84 req-b1f6609b-fe0a-4943-99a5-fd0cf3077c96 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:12.507757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-5a035408-c0f4-47d3-b239-3a88eb3b9e84 req-b1f6609b-fe0a-4943-99a5-fd0cf3077c96 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:12.508438 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-5a035408-c0f4-47d3-b239-3a88eb3b9e84 req-b1f6609b-fe0a-4943-99a5-fd0cf3077c96 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:12.522583 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-5a035408-c0f4-47d3-b239-3a88eb3b9e84 req-b1f6609b-fe0a-4943-99a5-fd0cf3077c96 service nova] Creating event network-vif-unplugged:906fb0c9-14b7-4949-943a-c084b122ae8b for instance b7b1312a-8b45-4481-9a44-f330379d0c8f on hv-cinder-84496 Sep 14 12:11:12.527973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-5a035408-c0f4-47d3-b239-3a88eb3b9e84 req-b1f6609b-fe0a-4943-99a5-fd0cf3077c96 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040715 Sep 14 12:11:12.528603 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 307/624] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:11:13.070384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:13.070996 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:13.072946 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=52 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:13.077702 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:13.078214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:13.078650 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:13.079418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:13.087132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:13.087132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:13.230055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:13.238746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:13.240272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:13.241436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-67ff66ec-fcc0-4817-af45-106f09a158d5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1721 microversion: 2.20 time: 0.175257 Sep 14 12:11:13.242031 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 318/625] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:13 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:13.518215 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6e226356-5c85-40a3-b649-6512361ff3c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:13.519062 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6e226356-5c85-40a3-b649-6512361ff3c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:13.526186 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e226356-5c85-40a3-b649-6512361ff3c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:13.526680 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e226356-5c85-40a3-b649-6512361ff3c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:13.527158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e226356-5c85-40a3-b649-6512361ff3c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:13.527808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e226356-5c85-40a3-b649-6512361ff3c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:13.528258 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e226356-5c85-40a3-b649-6512361ff3c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:13.528678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e226356-5c85-40a3-b649-6512361ff3c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:13.659376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6e226356-5c85-40a3-b649-6512361ff3c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:13.668151 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6e226356-5c85-40a3-b649-6512361ff3c6 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1701 microversion: 2.1 time: 0.154674 Sep 14 12:11:13.668727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 308/626] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:13 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:13.691890 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-63ba5cff-2cd5-4aa2-87d3-31277d3556bf tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:11:13.698089 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-63ba5cff-2cd5-4aa2-87d3-31277d3556bf tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:13.698602 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-63ba5cff-2cd5-4aa2-87d3-31277d3556bf tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:13.699049 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-63ba5cff-2cd5-4aa2-87d3-31277d3556bf tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:13.770132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-63ba5cff-2cd5-4aa2-87d3-31277d3556bf tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Going to try to start instance {{(pid=121152) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 12:11:13.995213 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-63ba5cff-2cd5-4aa2-87d3-31277d3556bf tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/action" status: 202 len: 0 microversion: 2.1 time: 0.307010 Sep 14 12:11:13.995821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 319/627] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:11:13 2022] POST /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:11:14.004098 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-58f569d6-70eb-43e5-81c2-fc088650e0f0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:14.004706 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-58f569d6-70eb-43e5-81c2-fc088650e0f0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:14.010675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58f569d6-70eb-43e5-81c2-fc088650e0f0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:14.011162 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58f569d6-70eb-43e5-81c2-fc088650e0f0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:14.011604 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58f569d6-70eb-43e5-81c2-fc088650e0f0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:14.012341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58f569d6-70eb-43e5-81c2-fc088650e0f0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:14.012799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58f569d6-70eb-43e5-81c2-fc088650e0f0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:14.013218 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-58f569d6-70eb-43e5-81c2-fc088650e0f0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:14.152921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-58f569d6-70eb-43e5-81c2-fc088650e0f0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:14.161649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-58f569d6-70eb-43e5-81c2-fc088650e0f0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1710 microversion: 2.1 time: 0.161403 Sep 14 12:11:14.162267 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 309/628] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:13 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:14.267114 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:14.267840 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:14.274936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:14.275425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:14.275853 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:14.276538 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:14.276996 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:14.277412 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:14.407333 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:14.416124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:14.417567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:14.418760 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9f4ef395-655a-49dd-9fae-247a262d7056 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1721 microversion: 2.20 time: 0.156384 Sep 14 12:11:14.419314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 320/629] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:14 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:15.186130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6925a933-b3c0-4167-bb9c-5b2ff243e3a9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:15.186737 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6925a933-b3c0-4167-bb9c-5b2ff243e3a9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:15.193932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6925a933-b3c0-4167-bb9c-5b2ff243e3a9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:15.194493 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6925a933-b3c0-4167-bb9c-5b2ff243e3a9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:15.195024 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6925a933-b3c0-4167-bb9c-5b2ff243e3a9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:15.195804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6925a933-b3c0-4167-bb9c-5b2ff243e3a9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:15.196265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6925a933-b3c0-4167-bb9c-5b2ff243e3a9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:15.196845 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6925a933-b3c0-4167-bb9c-5b2ff243e3a9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:15.413959 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6925a933-b3c0-4167-bb9c-5b2ff243e3a9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:15.423571 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6925a933-b3c0-4167-bb9c-5b2ff243e3a9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1710 microversion: 2.1 time: 0.241314 Sep 14 12:11:15.424368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 310/630] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:15 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1710 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:15.444673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:15.445301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:15.451690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:15.452817 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:15.452817 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:15.453469 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:15.453961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:15.454390 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:15.606766 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:15.615358 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:15.616810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:15.618020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cbc15429-5e61-481f-b1cf-a8029e63833d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1724 microversion: 2.20 time: 0.177590 Sep 14 12:11:15.618587 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 321/631] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:15 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:15.644804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2f5d3c71-ad3b-43d8-b6ee-72b8c0b71694 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24a79ffa-b8a2-4bb0-95fd-892ab6ce766c"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:11:15.648028 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2f5d3c71-ad3b-43d8-b6ee-72b8c0b71694 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:15.654805 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f5d3c71-ad3b-43d8-b6ee-72b8c0b71694 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:15.655415 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f5d3c71-ad3b-43d8-b6ee-72b8c0b71694 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:15.655851 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f5d3c71-ad3b-43d8-b6ee-72b8c0b71694 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:15.656565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f5d3c71-ad3b-43d8-b6ee-72b8c0b71694 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:15.657018 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f5d3c71-ad3b-43d8-b6ee-72b8c0b71694 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:15.657437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f5d3c71-ad3b-43d8-b6ee-72b8c0b71694 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:16.447982 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-54365a77-8641-47cc-bd3b-a4b8fa401127 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:16.448598 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-54365a77-8641-47cc-bd3b-a4b8fa401127 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:16.455704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54365a77-8641-47cc-bd3b-a4b8fa401127 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:16.456228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54365a77-8641-47cc-bd3b-a4b8fa401127 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:16.456662 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54365a77-8641-47cc-bd3b-a4b8fa401127 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:16.457345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54365a77-8641-47cc-bd3b-a4b8fa401127 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:16.457796 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54365a77-8641-47cc-bd3b-a4b8fa401127 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:16.461064 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54365a77-8641-47cc-bd3b-a4b8fa401127 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:16.593424 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-54365a77-8641-47cc-bd3b-a4b8fa401127 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:16.603067 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-54365a77-8641-47cc-bd3b-a4b8fa401127 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1710 microversion: 2.1 time: 0.159405 Sep 14 12:11:16.603681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 322/632] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:16 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:11:16.654267 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2f5d3c71-ad3b-43d8-b6ee-72b8c0b71694 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "POST /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.013578 Sep 14 12:11:16.654874 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 311/633] 10.222.0.62 () {62 vars in 1364 bytes} [Wed Sep 14 12:11:15 2022] POST /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments => generated 188 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:11:16.784513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ebcd6c5f-b2b2-4528-b53e-bedcd0ecf3b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:11:16.785104 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ebcd6c5f-b2b2-4528-b53e-bedcd0ecf3b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:16.791915 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ebcd6c5f-b2b2-4528-b53e-bedcd0ecf3b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:16.792401 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ebcd6c5f-b2b2-4528-b53e-bedcd0ecf3b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:16.792836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ebcd6c5f-b2b2-4528-b53e-bedcd0ecf3b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:16.793533 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ebcd6c5f-b2b2-4528-b53e-bedcd0ecf3b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:16.794026 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ebcd6c5f-b2b2-4528-b53e-bedcd0ecf3b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:16.794454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ebcd6c5f-b2b2-4528-b53e-bedcd0ecf3b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:16.880781 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ebcd6c5f-b2b2-4528-b53e-bedcd0ecf3b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121152) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 12:11:17.148622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ebcd6c5f-b2b2-4528-b53e-bedcd0ecf3b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "POST /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/action" status: 202 len: 0 microversion: 2.20 time: 0.367967 Sep 14 12:11:17.149229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 323/634] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Sep 14 12:11:16 2022] POST /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:11:17.157852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:17.158667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:17.166532 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:17.167025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:17.167458 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:17.168155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:17.168629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:17.169055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:17.174585 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:17.305799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:17.315437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:17.316886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:17.318617 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a1109d6f-c639-4661-95ca-cdbc8d79b87d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1750 microversion: 2.20 time: 0.164354 Sep 14 12:11:17.319503 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 312/635] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:17 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:17.628027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-26f19b20-93b7-4ef7-9f36-abfd5ea3ad95 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:17.628627 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-26f19b20-93b7-4ef7-9f36-abfd5ea3ad95 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:17.635478 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-26f19b20-93b7-4ef7-9f36-abfd5ea3ad95 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:17.635959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-26f19b20-93b7-4ef7-9f36-abfd5ea3ad95 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:17.636389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-26f19b20-93b7-4ef7-9f36-abfd5ea3ad95 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:17.637124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-26f19b20-93b7-4ef7-9f36-abfd5ea3ad95 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:17.637574 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-26f19b20-93b7-4ef7-9f36-abfd5ea3ad95 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:17.638099 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-26f19b20-93b7-4ef7-9f36-abfd5ea3ad95 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:17.784724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-26f19b20-93b7-4ef7-9f36-abfd5ea3ad95 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:17.793555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-26f19b20-93b7-4ef7-9f36-abfd5ea3ad95 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1710 microversion: 2.1 time: 0.170121 Sep 14 12:11:17.794170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 324/636] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:17 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1710 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:18.344612 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:18.345206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:18.352985 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:18.353471 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:18.353944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:18.354646 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:18.355096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:18.355525 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:18.489150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:18.497005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:18.498490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:18.499662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f155f3ad-0bf1-4cb7-846e-96d38f28d990 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1750 microversion: 2.20 time: 0.158997 Sep 14 12:11:18.500234 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 313/637] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:18 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:18.817030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bf537648-b422-4daa-a6ac-9688f75d6f90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:18.817634 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-bf537648-b422-4daa-a6ac-9688f75d6f90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:18.824655 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf537648-b422-4daa-a6ac-9688f75d6f90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:18.825228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf537648-b422-4daa-a6ac-9688f75d6f90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:18.825557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf537648-b422-4daa-a6ac-9688f75d6f90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:18.826280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf537648-b422-4daa-a6ac-9688f75d6f90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:18.826734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf537648-b422-4daa-a6ac-9688f75d6f90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:18.827154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf537648-b422-4daa-a6ac-9688f75d6f90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:18.957133 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bf537648-b422-4daa-a6ac-9688f75d6f90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:18.966081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bf537648-b422-4daa-a6ac-9688f75d6f90 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1710 microversion: 2.1 time: 0.152719 Sep 14 12:11:18.966711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 325/638] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:18 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:19.524514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:19.526111 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:19.532478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:19.532968 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:19.533412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:19.534270 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:19.534636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:19.535067 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:19.667607 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:19.676715 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:19.678186 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:19.679367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-854f25c6-bd59-4ec9-a2e9-d127d74f3d62 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1750 microversion: 2.20 time: 0.158731 Sep 14 12:11:19.679936 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 314/639] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:19 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:19.989991 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5856ac53-819d-42ab-89bb-92becc616dc3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:19.990603 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5856ac53-819d-42ab-89bb-92becc616dc3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:19.997039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5856ac53-819d-42ab-89bb-92becc616dc3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:19.997520 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5856ac53-819d-42ab-89bb-92becc616dc3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:19.998061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5856ac53-819d-42ab-89bb-92becc616dc3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:19.998851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5856ac53-819d-42ab-89bb-92becc616dc3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:19.999403 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5856ac53-819d-42ab-89bb-92becc616dc3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:19.999827 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5856ac53-819d-42ab-89bb-92becc616dc3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:20.127743 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5856ac53-819d-42ab-89bb-92becc616dc3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:20.135957 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5856ac53-819d-42ab-89bb-92becc616dc3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1710 microversion: 2.1 time: 0.149903 Sep 14 12:11:20.136527 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 326/640] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:19 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:20.704832 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:20.705487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:20.711971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:20.712481 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:20.712946 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:20.713640 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:20.714124 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:20.714583 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:20.868345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:20.877973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:20.882542 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:20.882542 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-02229200-4c3d-4a74-a658-915319e9d85d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1752 microversion: 2.20 time: 0.179650 Sep 14 12:11:20.882542 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 315/641] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:20 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:20.965922 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1138706114", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "networks": [{"uuid": "39f8e997-0bf2-4e00-afc8-b558c863face"}]}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:11:21.023650 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.network.neutron [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] validate_networks() for [('39f8e997-0bf2-4e00-afc8-b558c863face', None, None, None, None, None)] {{(pid=121152) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:11:21.160166 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c41d1d37-098b-4c61-8c2f-e3127119a6c0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:21.160911 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c41d1d37-098b-4c61-8c2f-e3127119a6c0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:21.167602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c41d1d37-098b-4c61-8c2f-e3127119a6c0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:21.168177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c41d1d37-098b-4c61-8c2f-e3127119a6c0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:21.168727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c41d1d37-098b-4c61-8c2f-e3127119a6c0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:21.169512 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c41d1d37-098b-4c61-8c2f-e3127119a6c0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:21.170207 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c41d1d37-098b-4c61-8c2f-e3127119a6c0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:21.170711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c41d1d37-098b-4c61-8c2f-e3127119a6c0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:21.397332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c41d1d37-098b-4c61-8c2f-e3127119a6c0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:21.406396 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c41d1d37-098b-4c61-8c2f-e3127119a6c0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1714 microversion: 2.1 time: 0.250342 Sep 14 12:11:21.406983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 316/642] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:21 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1714 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:21.483418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Flavor limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:11:21.483875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Image limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:11:21.484393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Flavor pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:11:21.484812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Image pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:11:21.485246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:11:21.494406 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:21.497937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:21.497937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:21.497937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:21.497937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:21.498331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:21.514232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Getting quotas for project 1488f00baa934f2e9b910644a179c755. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:11:21.518324 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Getting quotas for user 8fe575351bdc456682db592f0c723ea6 and project 1488f00baa934f2e9b910644a179c755. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:11:21.530290 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Going to run 1 instances... {{(pid=121152) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:11:21.532671 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:11:21.694171 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-192fa809-58cd-41ad-9df3-494b76d48711 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732346 Sep 14 12:11:21.695010 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 327/643] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:11:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 12:11:21.707183 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a1737285-9c8b-4b49-a09c-8c6de6e8814a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:21.707894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a1737285-9c8b-4b49-a09c-8c6de6e8814a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:21.763582 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a1737285-9c8b-4b49-a09c-8c6de6e8814a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:21.771529 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a1737285-9c8b-4b49-a09c-8c6de6e8814a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1219 microversion: 2.1 time: 0.068461 Sep 14 12:11:21.773164 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 317/644] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:21 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:21.907343 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:21.907973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:21.914503 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:21.914985 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:21.915466 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:21.916144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:21.916588 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:21.917007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:22.054836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:22.068562 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:22.070090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:22.071326 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-05d0266f-1b79-4672-9464-e69cf30ca1f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1752 microversion: 2.20 time: 0.167824 Sep 14 12:11:22.072903 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 328/645] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:21 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:22.797056 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-04936630-08b3-45a4-98f0-091f58202a61 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:22.797660 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-04936630-08b3-45a4-98f0-091f58202a61 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:22.804041 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04936630-08b3-45a4-98f0-091f58202a61 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:22.804529 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04936630-08b3-45a4-98f0-091f58202a61 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:22.804965 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04936630-08b3-45a4-98f0-091f58202a61 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:22.805657 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04936630-08b3-45a4-98f0-091f58202a61 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:22.806372 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04936630-08b3-45a4-98f0-091f58202a61 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:22.806807 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04936630-08b3-45a4-98f0-091f58202a61 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:22.873144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-04936630-08b3-45a4-98f0-091f58202a61 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:22.881636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-04936630-08b3-45a4-98f0-091f58202a61 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1223 microversion: 2.1 time: 0.088464 Sep 14 12:11:22.882357 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 318/646] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:22 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:23.097049 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:23.097659 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:23.104165 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:23.104624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:23.105060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:23.105745 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:23.106225 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:23.106648 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:23.110647 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:23.240694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:23.250119 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:23.251621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:23.253265 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2b856433-7477-4d23-9f7f-ccd466b93a4e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.159940 Sep 14 12:11:23.254209 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 329/647] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:23 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:23.905382 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-04d7ee41-70ba-4027-9b66-47a4c89432c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:23.906505 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-04d7ee41-70ba-4027-9b66-47a4c89432c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:23.912537 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04d7ee41-70ba-4027-9b66-47a4c89432c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:23.913026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04d7ee41-70ba-4027-9b66-47a4c89432c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:23.913472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04d7ee41-70ba-4027-9b66-47a4c89432c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:23.914200 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04d7ee41-70ba-4027-9b66-47a4c89432c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:23.914659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04d7ee41-70ba-4027-9b66-47a4c89432c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:23.915087 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04d7ee41-70ba-4027-9b66-47a4c89432c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:23.976815 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-04d7ee41-70ba-4027-9b66-47a4c89432c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:23.984556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-04d7ee41-70ba-4027-9b66-47a4c89432c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1271 microversion: 2.1 time: 0.083002 Sep 14 12:11:23.985126 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 319/648] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:23 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:11:24.278719 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:24.279579 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:24.287013 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:24.287492 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:24.288133 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:24.288990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:24.289643 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:24.290089 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:24.495905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:24.504830 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:24.506450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:24.508470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2d59b296-c791-4bf7-97aa-e6c62db5d631 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.234056 Sep 14 12:11:24.514921 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 330/649] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:24 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:25.008053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cd788c70-22ae-48c4-8318-7e5660457269 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:25.008699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cd788c70-22ae-48c4-8318-7e5660457269 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:25.015670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd788c70-22ae-48c4-8318-7e5660457269 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:25.016354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd788c70-22ae-48c4-8318-7e5660457269 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:25.016792 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd788c70-22ae-48c4-8318-7e5660457269 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:25.017488 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd788c70-22ae-48c4-8318-7e5660457269 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:25.017962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd788c70-22ae-48c4-8318-7e5660457269 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:25.018386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd788c70-22ae-48c4-8318-7e5660457269 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:25.097221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cd788c70-22ae-48c4-8318-7e5660457269 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:25.107762 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cd788c70-22ae-48c4-8318-7e5660457269 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1277 microversion: 2.1 time: 0.103482 Sep 14 12:11:25.112804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 320/650] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:25 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:25.535707 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:25.536727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:25.544700 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:25.545350 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:25.545786 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:25.546703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:25.547156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:25.547654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:25.699244 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:25.713005 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:25.714997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:25.716541 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1ed17a5c-1103-479d-885f-16c7666976b0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.185834 Sep 14 12:11:25.717759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 331/651] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:25 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:26.137090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b758d055-374c-4e69-b358-b026740021c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:26.137708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b758d055-374c-4e69-b358-b026740021c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:26.144229 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b758d055-374c-4e69-b358-b026740021c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:26.144722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b758d055-374c-4e69-b358-b026740021c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:26.145164 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b758d055-374c-4e69-b358-b026740021c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:26.145925 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b758d055-374c-4e69-b358-b026740021c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:26.146389 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b758d055-374c-4e69-b358-b026740021c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:26.146820 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b758d055-374c-4e69-b358-b026740021c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:26.283839 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b758d055-374c-4e69-b358-b026740021c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:26.302312 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b758d055-374c-4e69-b358-b026740021c5 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.169480 Sep 14 12:11:26.303234 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 321/652] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:26 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:26.743007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:26.743742 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:26.750610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:26.751141 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:26.751580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:26.752276 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:26.752729 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:26.753151 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:26.913674 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:26.931278 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:26.934155 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:26.936104 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8ac5345c-447b-4116-96fe-ffaf9d25bebd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.196935 Sep 14 12:11:26.936957 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 332/653] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:26 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:27.327007 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-be2f869a-b03a-4735-8185-60b79a70c141 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:27.327643 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-be2f869a-b03a-4735-8185-60b79a70c141 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:27.334199 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2f869a-b03a-4735-8185-60b79a70c141 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:27.334714 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2f869a-b03a-4735-8185-60b79a70c141 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:27.335156 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2f869a-b03a-4735-8185-60b79a70c141 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:27.335857 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2f869a-b03a-4735-8185-60b79a70c141 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:27.336309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2f869a-b03a-4735-8185-60b79a70c141 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:27.336735 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2f869a-b03a-4735-8185-60b79a70c141 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:27.469725 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-be2f869a-b03a-4735-8185-60b79a70c141 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:27.477469 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-be2f869a-b03a-4735-8185-60b79a70c141 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.154244 Sep 14 12:11:27.478757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 322/654] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:27 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:27.970509 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:27.971419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:27.977605 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:27.978784 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:27.979187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:27.979880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:27.980325 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:27.980740 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:28.126067 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:28.135682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:28.137136 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:28.138383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4456489d-ef13-4683-b2a8-8f329a15c288 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.171742 Sep 14 12:11:28.138951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 333/655] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:27 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:28.500948 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-65dbe557-8275-47b4-8f9a-8f798da22e98 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:28.501565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-65dbe557-8275-47b4-8f9a-8f798da22e98 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:28.508152 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65dbe557-8275-47b4-8f9a-8f798da22e98 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:28.508642 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65dbe557-8275-47b4-8f9a-8f798da22e98 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:28.509119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65dbe557-8275-47b4-8f9a-8f798da22e98 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:28.509924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65dbe557-8275-47b4-8f9a-8f798da22e98 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:28.510386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65dbe557-8275-47b4-8f9a-8f798da22e98 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:28.510821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65dbe557-8275-47b4-8f9a-8f798da22e98 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:28.666146 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-65dbe557-8275-47b4-8f9a-8f798da22e98 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:28.677950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-65dbe557-8275-47b4-8f9a-8f798da22e98 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.180878 Sep 14 12:11:28.678534 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 323/656] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:28 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:29.163875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:29.164490 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:29.171108 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:29.171590 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:29.172019 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:29.172712 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:29.173156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:29.173570 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:29.319058 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:29.338828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:29.340606 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:29.342215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f6680900-f4b0-4e93-9ec1-41f46cc129aa tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.182218 Sep 14 12:11:29.342777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 334/657] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:29 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:29.705359 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6e768913-2632-4ab0-80d5-7d8539c7655a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:29.706006 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6e768913-2632-4ab0-80d5-7d8539c7655a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:29.712636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e768913-2632-4ab0-80d5-7d8539c7655a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:29.713119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e768913-2632-4ab0-80d5-7d8539c7655a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:29.713561 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e768913-2632-4ab0-80d5-7d8539c7655a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:29.714295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e768913-2632-4ab0-80d5-7d8539c7655a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:29.714749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e768913-2632-4ab0-80d5-7d8539c7655a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:29.715179 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e768913-2632-4ab0-80d5-7d8539c7655a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:30.103442 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6e768913-2632-4ab0-80d5-7d8539c7655a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:30.111359 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6e768913-2632-4ab0-80d5-7d8539c7655a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.409867 Sep 14 12:11:30.111948 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 324/658] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:29 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:30.367927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:30.368470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:30.375144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:30.375637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:30.376077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:30.376775 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:30.377230 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:30.377655 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:30.512093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:30.520851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:30.522417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:30.523578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bc4ef044-12bb-450c-a52d-6a21fe5c4d29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.159673 Sep 14 12:11:30.524138 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 335/659] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:30 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:31.135203 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a1c4f179-ece5-4a55-b650-92f6ecb640ec tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:31.135812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a1c4f179-ece5-4a55-b650-92f6ecb640ec tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:31.142200 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1c4f179-ece5-4a55-b650-92f6ecb640ec tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:31.142685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1c4f179-ece5-4a55-b650-92f6ecb640ec tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:31.143125 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1c4f179-ece5-4a55-b650-92f6ecb640ec tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:31.143811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1c4f179-ece5-4a55-b650-92f6ecb640ec tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:31.144264 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1c4f179-ece5-4a55-b650-92f6ecb640ec tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:31.144690 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a1c4f179-ece5-4a55-b650-92f6ecb640ec tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:31.273661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a1c4f179-ece5-4a55-b650-92f6ecb640ec tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:31.281473 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a1c4f179-ece5-4a55-b650-92f6ecb640ec tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.150770 Sep 14 12:11:31.282076 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 325/660] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:31 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:31.548800 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:31.549337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:31.551844 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:31.552585 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=6 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:31.557453 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:31.557977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:31.558417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:31.559107 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:31.559595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:31.560020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:31.692298 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:31.702053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:31.703837 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:31.704816 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7950d040-c7ff-41b3-9ba4-0245c2885b79 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.160112 Sep 14 12:11:31.705524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 336/661] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:31 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:32.304923 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0e10d695-9cc6-45e9-ab57-2d26f302355b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:32.305537 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0e10d695-9cc6-45e9-ab57-2d26f302355b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:32.307414 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:32.312970 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e10d695-9cc6-45e9-ab57-2d26f302355b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:32.313462 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e10d695-9cc6-45e9-ab57-2d26f302355b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:32.313931 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e10d695-9cc6-45e9-ab57-2d26f302355b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:32.314641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e10d695-9cc6-45e9-ab57-2d26f302355b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:32.315220 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e10d695-9cc6-45e9-ab57-2d26f302355b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:32.315653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0e10d695-9cc6-45e9-ab57-2d26f302355b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:32.450203 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0e10d695-9cc6-45e9-ab57-2d26f302355b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:32.458190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0e10d695-9cc6-45e9-ab57-2d26f302355b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.157121 Sep 14 12:11:32.458830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 326/662] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:32 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:32.730960 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:32.731507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:32.738436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:32.738921 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:32.739348 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:32.740036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:32.740479 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:32.740897 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:32.877161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:32.887050 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:32.888544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:32.889717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-728639e6-7f95-47ae-8126-7924c71b1340 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.163612 Sep 14 12:11:32.890322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 337/663] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:32 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:33.482009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f9cc8513-6ed8-4574-a6fe-00f3fc935121 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:33.482693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f9cc8513-6ed8-4574-a6fe-00f3fc935121 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:33.489135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f9cc8513-6ed8-4574-a6fe-00f3fc935121 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:33.489618 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f9cc8513-6ed8-4574-a6fe-00f3fc935121 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:33.490090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f9cc8513-6ed8-4574-a6fe-00f3fc935121 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:33.490786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f9cc8513-6ed8-4574-a6fe-00f3fc935121 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:33.491237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f9cc8513-6ed8-4574-a6fe-00f3fc935121 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:33.491660 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f9cc8513-6ed8-4574-a6fe-00f3fc935121 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:33.632409 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f9cc8513-6ed8-4574-a6fe-00f3fc935121 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:33.641121 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f9cc8513-6ed8-4574-a6fe-00f3fc935121 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.163476 Sep 14 12:11:33.641704 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 327/664] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:33 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:33.925643 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:33.927155 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:33.934439 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:33.984437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:33.984437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:33.984437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:33.984437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:33.984868 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:34.094479 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:34.103904 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:34.105329 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:34.106622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c0bbeb09-25a5-49fe-b74e-f7da3e6e39e5 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.186312 Sep 14 12:11:34.107094 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 338/665] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:33 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:34.667349 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6db1b9c4-30c5-49b5-a67a-128fa14ad71c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:34.667966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6db1b9c4-30c5-49b5-a67a-128fa14ad71c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:34.676818 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6db1b9c4-30c5-49b5-a67a-128fa14ad71c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:34.677265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6db1b9c4-30c5-49b5-a67a-128fa14ad71c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:34.677779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6db1b9c4-30c5-49b5-a67a-128fa14ad71c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:34.678750 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6db1b9c4-30c5-49b5-a67a-128fa14ad71c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:34.679208 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6db1b9c4-30c5-49b5-a67a-128fa14ad71c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:34.679636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6db1b9c4-30c5-49b5-a67a-128fa14ad71c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:34.836332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6db1b9c4-30c5-49b5-a67a-128fa14ad71c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:34.844559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6db1b9c4-30c5-49b5-a67a-128fa14ad71c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.183343 Sep 14 12:11:34.845134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 328/666] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:34 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:35.131741 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:35.132392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:35.139677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:35.140156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:35.140584 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:35.141265 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:35.141710 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:35.142153 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:35.288972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:35.298800 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:35.300316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:35.301517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-30cd46ec-5da3-4e88-b9c2-ed6a85bd16c2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.173694 Sep 14 12:11:35.302119 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 339/667] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:35 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:35.867748 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a5bd7263-adc2-4c9e-80fc-0ddadba8b3d3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:35.868363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a5bd7263-adc2-4c9e-80fc-0ddadba8b3d3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:35.874658 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5bd7263-adc2-4c9e-80fc-0ddadba8b3d3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:35.875135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5bd7263-adc2-4c9e-80fc-0ddadba8b3d3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:35.875563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5bd7263-adc2-4c9e-80fc-0ddadba8b3d3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:35.876243 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5bd7263-adc2-4c9e-80fc-0ddadba8b3d3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:35.876688 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5bd7263-adc2-4c9e-80fc-0ddadba8b3d3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:35.877104 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a5bd7263-adc2-4c9e-80fc-0ddadba8b3d3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:36.062190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a5bd7263-adc2-4c9e-80fc-0ddadba8b3d3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:36.065765 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:36.070272 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a5bd7263-adc2-4c9e-80fc-0ddadba8b3d3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.206583 Sep 14 12:11:36.070848 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 329/668] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:35 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:36.330217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:36.331282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:36.339835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:36.340390 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:36.340952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:36.342198 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:36.343014 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:36.343736 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:36.507647 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:36.517746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:36.519221 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:36.520509 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bb1d8f0b-a6a3-4826-8124-78c5226eb594 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.196664 Sep 14 12:11:36.521259 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 340/669] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:36 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:37.094602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6f2f862a-6cf5-4b20-96fb-f6084647c9ff tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:37.095223 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6f2f862a-6cf5-4b20-96fb-f6084647c9ff tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:37.101796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f2f862a-6cf5-4b20-96fb-f6084647c9ff tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:37.102314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f2f862a-6cf5-4b20-96fb-f6084647c9ff tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:37.103413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f2f862a-6cf5-4b20-96fb-f6084647c9ff tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:37.104204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f2f862a-6cf5-4b20-96fb-f6084647c9ff tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:37.104662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f2f862a-6cf5-4b20-96fb-f6084647c9ff tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:37.105094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6f2f862a-6cf5-4b20-96fb-f6084647c9ff tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:37.259564 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6f2f862a-6cf5-4b20-96fb-f6084647c9ff tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:37.267371 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6f2f862a-6cf5-4b20-96fb-f6084647c9ff tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.176908 Sep 14 12:11:37.267953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 330/670] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:37 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:37.553518 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:37.556985 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:37.572189 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:37.573164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:37.573826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:37.575110 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:37.576235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:37.577153 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:37.765007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:37.777064 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:37.778545 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:37.779717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-38e0a88d-7c87-4ffd-86c0-f0857a218430 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.236130 Sep 14 12:11:37.780285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 341/671] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:37 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:38.295511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f3c6979e-1013-4f94-8b4f-c4c03f1fa364 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:38.296135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f3c6979e-1013-4f94-8b4f-c4c03f1fa364 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:38.302591 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3c6979e-1013-4f94-8b4f-c4c03f1fa364 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:38.303077 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3c6979e-1013-4f94-8b4f-c4c03f1fa364 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:38.303509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3c6979e-1013-4f94-8b4f-c4c03f1fa364 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:38.304204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3c6979e-1013-4f94-8b4f-c4c03f1fa364 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:38.304658 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3c6979e-1013-4f94-8b4f-c4c03f1fa364 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:38.305091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3c6979e-1013-4f94-8b4f-c4c03f1fa364 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:38.440926 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f3c6979e-1013-4f94-8b4f-c4c03f1fa364 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:38.449622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f3c6979e-1013-4f94-8b4f-c4c03f1fa364 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.157954 Sep 14 12:11:38.450245 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 331/672] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:38 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:38.806234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:38.806837 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:38.813952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:38.814436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:38.814861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:38.815540 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:38.815981 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:38.816396 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:38.972726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:38.981323 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:38.982797 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:38.984556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-84689de2-256d-4903-b8b6-d357526551ec tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.182240 Sep 14 12:11:38.985118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 342/673] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:38 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:39.476357 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bde9a074-7773-4e45-861f-de203c039c1e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:39.476357 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bde9a074-7773-4e45-861f-de203c039c1e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:39.480696 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=60 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:39.487442 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bde9a074-7773-4e45-861f-de203c039c1e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:39.488040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bde9a074-7773-4e45-861f-de203c039c1e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:39.488542 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bde9a074-7773-4e45-861f-de203c039c1e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:39.489360 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bde9a074-7773-4e45-861f-de203c039c1e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:39.489933 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bde9a074-7773-4e45-861f-de203c039c1e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:39.490430 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bde9a074-7773-4e45-861f-de203c039c1e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:39.659334 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bde9a074-7773-4e45-861f-de203c039c1e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:39.676353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bde9a074-7773-4e45-861f-de203c039c1e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.205705 Sep 14 12:11:39.676989 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 332/674] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:39 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:40.009640 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:40.010390 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:40.017141 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:40.017616 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:40.018076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:40.018759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:40.019202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:40.019617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:40.183271 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:40.193158 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:40.194769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:40.195929 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-25271e3b-e4bd-46c9-842f-758787f2049b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.190255 Sep 14 12:11:40.196501 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 343/675] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:40 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:40.709900 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-673fa149-2c7d-4ea2-ae58-4287e86418f3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:40.711682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-673fa149-2c7d-4ea2-ae58-4287e86418f3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:40.719865 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-673fa149-2c7d-4ea2-ae58-4287e86418f3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:40.720351 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-673fa149-2c7d-4ea2-ae58-4287e86418f3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:40.720783 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-673fa149-2c7d-4ea2-ae58-4287e86418f3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:40.721522 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-673fa149-2c7d-4ea2-ae58-4287e86418f3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:40.722002 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-673fa149-2c7d-4ea2-ae58-4287e86418f3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:40.722426 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-673fa149-2c7d-4ea2-ae58-4287e86418f3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:40.886898 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-673fa149-2c7d-4ea2-ae58-4287e86418f3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:40.906192 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-673fa149-2c7d-4ea2-ae58-4287e86418f3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.204244 Sep 14 12:11:40.917984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 333/676] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:40 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:41.226182 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:41.226848 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:41.235340 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:41.235832 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:41.236278 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:41.240245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:41.240245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:41.240245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:41.379363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:41.389165 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:41.390651 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:41.391804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d72d6135-efcc-4770-b851-743f34dc99bf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.169604 Sep 14 12:11:41.392366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 344/677] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:41 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:41.930345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-08523d07-b357-4bc0-90a6-8433a9eeb6d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:41.931370 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-08523d07-b357-4bc0-90a6-8433a9eeb6d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:41.939563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08523d07-b357-4bc0-90a6-8433a9eeb6d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:41.940438 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08523d07-b357-4bc0-90a6-8433a9eeb6d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:41.941207 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08523d07-b357-4bc0-90a6-8433a9eeb6d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:41.942493 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08523d07-b357-4bc0-90a6-8433a9eeb6d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:41.943543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08523d07-b357-4bc0-90a6-8433a9eeb6d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:41.944287 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-08523d07-b357-4bc0-90a6-8433a9eeb6d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:42.086421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-08523d07-b357-4bc0-90a6-8433a9eeb6d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:42.095311 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-08523d07-b357-4bc0-90a6-8433a9eeb6d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.168778 Sep 14 12:11:42.095899 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 334/678] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:41 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:11:42.420315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:42.421320 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:42.428836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:42.429437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:42.429737 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:42.430702 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:42.431253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:42.431735 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:42.573897 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:42.577741 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:42.594668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:42.597449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:42.599896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0c5c97f2-a08c-4292-8149-3c0738ecfcf2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.184238 Sep 14 12:11:42.614775 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 345/679] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:42 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:43.118706 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3e2450f5-7316-4b82-8718-c9cc3aec9073 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:43.119824 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3e2450f5-7316-4b82-8718-c9cc3aec9073 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:43.126512 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e2450f5-7316-4b82-8718-c9cc3aec9073 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:43.127000 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e2450f5-7316-4b82-8718-c9cc3aec9073 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:43.127439 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e2450f5-7316-4b82-8718-c9cc3aec9073 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:43.128160 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e2450f5-7316-4b82-8718-c9cc3aec9073 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:43.128593 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e2450f5-7316-4b82-8718-c9cc3aec9073 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:43.129022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3e2450f5-7316-4b82-8718-c9cc3aec9073 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:43.281155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3e2450f5-7316-4b82-8718-c9cc3aec9073 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:43.290276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3e2450f5-7316-4b82-8718-c9cc3aec9073 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.175916 Sep 14 12:11:43.290848 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 335/680] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:43 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:43.639952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:43.640560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:43.642745 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:43.648787 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:43.649946 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:43.650743 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:43.651510 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:43.651965 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:43.652385 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:43.792084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:43.802198 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:43.803776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:43.805195 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6dbd890c-26af-4824-9e59-8bda8142f04a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.169536 Sep 14 12:11:43.806503 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 346/681] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:43 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:44.313435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-61dd3a62-5ad4-4f31-b693-f354927b452d tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:44.314082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-61dd3a62-5ad4-4f31-b693-f354927b452d tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:44.321038 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61dd3a62-5ad4-4f31-b693-f354927b452d tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:44.322094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61dd3a62-5ad4-4f31-b693-f354927b452d tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:44.322580 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61dd3a62-5ad4-4f31-b693-f354927b452d tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:44.323328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61dd3a62-5ad4-4f31-b693-f354927b452d tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:44.323828 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61dd3a62-5ad4-4f31-b693-f354927b452d tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:44.324291 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-61dd3a62-5ad4-4f31-b693-f354927b452d tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:44.483650 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-61dd3a62-5ad4-4f31-b693-f354927b452d tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:44.493938 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-61dd3a62-5ad4-4f31-b693-f354927b452d tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.183581 Sep 14 12:11:44.494902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 336/682] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:44 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:44.831720 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:44.832562 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:44.838948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:44.839427 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:44.839854 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:44.840536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:44.840976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:44.841391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:44.972970 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:44.982180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:44.983618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:44.984780 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0550a5c0-fa08-4d0d-b524-09616f58b2c4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.156968 Sep 14 12:11:44.985349 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 347/683] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:44 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:45.532039 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6c5d810f-5178-4f82-ad2b-4f95b4d73ded tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:45.532619 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6c5d810f-5178-4f82-ad2b-4f95b4d73ded tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:45.539411 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6c5d810f-5178-4f82-ad2b-4f95b4d73ded tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:45.539897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6c5d810f-5178-4f82-ad2b-4f95b4d73ded tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:45.540334 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6c5d810f-5178-4f82-ad2b-4f95b4d73ded tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:45.541030 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6c5d810f-5178-4f82-ad2b-4f95b4d73ded tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:45.541519 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6c5d810f-5178-4f82-ad2b-4f95b4d73ded tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:45.541940 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6c5d810f-5178-4f82-ad2b-4f95b4d73ded tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:45.678575 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6c5d810f-5178-4f82-ad2b-4f95b4d73ded tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:45.687615 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6c5d810f-5178-4f82-ad2b-4f95b4d73ded tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.159487 Sep 14 12:11:45.688194 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 337/684] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:45 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:46.010944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:46.011575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:46.018636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:46.019129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:46.019564 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:46.020333 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:46.020733 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:46.021156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:46.166919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:46.175842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:46.184436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:46.184436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-28dfd3f2-b71d-4d96-b0f7-5e1df117834d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.172338 Sep 14 12:11:46.184436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 348/685] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:46 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:46.454519 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-04f3fb02-3dc2-4815-ae09-e7f48d41c105 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:46.455016 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-04f3fb02-3dc2-4815-ae09-e7f48d41c105 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:46.461058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f3fb02-3dc2-4815-ae09-e7f48d41c105 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:46.461549 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f3fb02-3dc2-4815-ae09-e7f48d41c105 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:46.462627 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f3fb02-3dc2-4815-ae09-e7f48d41c105 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:46.463328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f3fb02-3dc2-4815-ae09-e7f48d41c105 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:46.463794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f3fb02-3dc2-4815-ae09-e7f48d41c105 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:46.464206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f3fb02-3dc2-4815-ae09-e7f48d41c105 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:46.501271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-04f3fb02-3dc2-4815-ae09-e7f48d41c105 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/ips" status: 200 len: 150 microversion: 2.1 time: 0.050579 Sep 14 12:11:46.502177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 338/686] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 14 12:11:46 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:11:46.710210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ed9c749e-867f-4579-8319-4853ef8831c6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:46.710905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ed9c749e-867f-4579-8319-4853ef8831c6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:46.717421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed9c749e-867f-4579-8319-4853ef8831c6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:46.717944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed9c749e-867f-4579-8319-4853ef8831c6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:46.718442 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed9c749e-867f-4579-8319-4853ef8831c6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:46.720060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed9c749e-867f-4579-8319-4853ef8831c6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:46.720060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed9c749e-867f-4579-8319-4853ef8831c6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:46.720060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ed9c749e-867f-4579-8319-4853ef8831c6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:46.935635 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ed9c749e-867f-4579-8319-4853ef8831c6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:46.943391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ed9c749e-867f-4579-8319-4853ef8831c6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.237445 Sep 14 12:11:46.950854 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 349/687] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:46 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:47.208473 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:47.208473 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:47.213513 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:47.214183 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:47.214713 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:47.215893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:47.216435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:47.216933 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:47.441143 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:47.451118 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:47.452693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:47.453905 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-78d77a70-8892-4d96-b3df-dcdb0ecb6721 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.252311 Sep 14 12:11:47.454491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 339/688] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:47 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:47.647674 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-2a02cccb-0e4b-48b7-866f-458fbf51ae44 req-31f879a2-7214-49b3-9ff5-4e494e8b3faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3a00ef7-7e76-4e05-9c55-03698e3a7a9f", "tag": "c85474c8-4ecf-4baf-84fe-1fd725604066"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:11:47.658581 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-2a02cccb-0e4b-48b7-866f-458fbf51ae44 req-31f879a2-7214-49b3-9ff5-4e494e8b3faa service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:47.659054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-2a02cccb-0e4b-48b7-866f-458fbf51ae44 req-31f879a2-7214-49b3-9ff5-4e494e8b3faa service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:47.659481 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-2a02cccb-0e4b-48b7-866f-458fbf51ae44 req-31f879a2-7214-49b3-9ff5-4e494e8b3faa service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:47.670961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-2a02cccb-0e4b-48b7-866f-458fbf51ae44 req-31f879a2-7214-49b3-9ff5-4e494e8b3faa service nova] Creating event network-changed:c85474c8-4ecf-4baf-84fe-1fd725604066 for instance c3a00ef7-7e76-4e05-9c55-03698e3a7a9f on hv-cinder-84496 Sep 14 12:11:47.676086 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-2a02cccb-0e4b-48b7-866f-458fbf51ae44 req-31f879a2-7214-49b3-9ff5-4e494e8b3faa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100011 Sep 14 12:11:47.679920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 350/689] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:11:47.967438 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-88ac69a1-3040-49d1-bbeb-a7a03150bff9 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:47.968047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-88ac69a1-3040-49d1-bbeb-a7a03150bff9 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:47.974112 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac69a1-3040-49d1-bbeb-a7a03150bff9 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:47.974643 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac69a1-3040-49d1-bbeb-a7a03150bff9 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:47.975023 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac69a1-3040-49d1-bbeb-a7a03150bff9 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:47.975711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac69a1-3040-49d1-bbeb-a7a03150bff9 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:47.976162 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac69a1-3040-49d1-bbeb-a7a03150bff9 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:47.976589 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ac69a1-3040-49d1-bbeb-a7a03150bff9 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:48.106968 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-88ac69a1-3040-49d1-bbeb-a7a03150bff9 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:48.114726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-88ac69a1-3040-49d1-bbeb-a7a03150bff9 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.151201 Sep 14 12:11:48.115529 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 340/690] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:47 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:48.481689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:48.482414 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:48.488880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:48.489370 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:48.489814 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:48.490535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:48.490990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:48.491454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:48.667493 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:48.676331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:48.677770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:48.678971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0468ce7d-bd28-42bf-ab47-fbe204c7b8f1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.202651 Sep 14 12:11:48.679539 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 351/691] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:48 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:49.137598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-86a5b877-18a7-4830-80ef-d4b5b89bbed4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:49.138246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-86a5b877-18a7-4830-80ef-d4b5b89bbed4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:49.144925 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86a5b877-18a7-4830-80ef-d4b5b89bbed4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:49.145417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86a5b877-18a7-4830-80ef-d4b5b89bbed4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:49.145950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86a5b877-18a7-4830-80ef-d4b5b89bbed4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:49.146661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86a5b877-18a7-4830-80ef-d4b5b89bbed4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:49.147122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86a5b877-18a7-4830-80ef-d4b5b89bbed4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:49.147559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-86a5b877-18a7-4830-80ef-d4b5b89bbed4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:49.390401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-86a5b877-18a7-4830-80ef-d4b5b89bbed4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:49.398946 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-86a5b877-18a7-4830-80ef-d4b5b89bbed4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.265659 Sep 14 12:11:49.400265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 341/692] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:49 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:49.400838 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-29f1332e-4abe-4088-99d5-175b81a278b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbee5dec-9cc7-4e9c-9b6b-563e1491f357"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:11:49.403313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-29f1332e-4abe-4088-99d5-175b81a278b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:49.409536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29f1332e-4abe-4088-99d5-175b81a278b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:49.410648 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29f1332e-4abe-4088-99d5-175b81a278b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:49.410648 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29f1332e-4abe-4088-99d5-175b81a278b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:49.411988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29f1332e-4abe-4088-99d5-175b81a278b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:49.411988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29f1332e-4abe-4088-99d5-175b81a278b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:49.411988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29f1332e-4abe-4088-99d5-175b81a278b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:49.704578 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:49.705192 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:49.711341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:49.712311 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:49.712782 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:49.713478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:49.713964 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:49.714390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:49.854413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:49.862041 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:49.863471 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:49.864626 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f00fd323-d13a-4bce-afb6-e3591c82d1f7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.163973 Sep 14 12:11:49.865181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 342/693] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:49 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:50.422324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e71ae0f9-53e7-4d2e-83ef-c607dd699023 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:50.423112 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e71ae0f9-53e7-4d2e-83ef-c607dd699023 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:50.429436 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e71ae0f9-53e7-4d2e-83ef-c607dd699023 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:50.429961 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e71ae0f9-53e7-4d2e-83ef-c607dd699023 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:50.430411 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e71ae0f9-53e7-4d2e-83ef-c607dd699023 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:50.431135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e71ae0f9-53e7-4d2e-83ef-c607dd699023 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:50.431590 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e71ae0f9-53e7-4d2e-83ef-c607dd699023 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:50.432015 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e71ae0f9-53e7-4d2e-83ef-c607dd699023 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:50.567552 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e71ae0f9-53e7-4d2e-83ef-c607dd699023 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:50.575174 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e71ae0f9-53e7-4d2e-83ef-c607dd699023 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.156744 Sep 14 12:11:50.575749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 343/694] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:50 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:11:50.889687 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:50.890326 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:50.896603 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:50.897101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:50.897539 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:50.898278 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:50.898737 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:50.899164 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:51.041539 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:51.050352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:51.051933 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:51.053106 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-648a9926-f102-40b0-95ca-11c7ea6b01ef tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.167418 Sep 14 12:11:51.053674 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 344/695] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:50 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:51.598727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-02f9632e-335b-4bfe-acb8-d09293717162 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:51.599614 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-02f9632e-335b-4bfe-acb8-d09293717162 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:51.605304 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02f9632e-335b-4bfe-acb8-d09293717162 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:51.605810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02f9632e-335b-4bfe-acb8-d09293717162 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:51.606278 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02f9632e-335b-4bfe-acb8-d09293717162 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:51.606981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02f9632e-335b-4bfe-acb8-d09293717162 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:51.607460 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02f9632e-335b-4bfe-acb8-d09293717162 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:51.607913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-02f9632e-335b-4bfe-acb8-d09293717162 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:51.740727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-02f9632e-335b-4bfe-acb8-d09293717162 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:51.749234 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-02f9632e-335b-4bfe-acb8-d09293717162 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.154520 Sep 14 12:11:51.749843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 345/696] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:51 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:11:52.079170 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:52.079788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:52.086117 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:52.086606 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:52.087042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:52.087739 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:52.088188 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:52.088981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:52.222981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:52.226467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:52.232338 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:52.233833 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:52.240097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e21cb113-c553-4894-a85d-f9685d225f35 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.159825 Sep 14 12:11:52.240097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 346/697] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:52 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:52.776927 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-35c56ed4-01b7-4d88-b902-a49f94814e16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:52.777721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-35c56ed4-01b7-4d88-b902-a49f94814e16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:52.785929 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35c56ed4-01b7-4d88-b902-a49f94814e16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:52.786427 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35c56ed4-01b7-4d88-b902-a49f94814e16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:52.786868 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35c56ed4-01b7-4d88-b902-a49f94814e16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:52.787747 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35c56ed4-01b7-4d88-b902-a49f94814e16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:52.788206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35c56ed4-01b7-4d88-b902-a49f94814e16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:52.788638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-35c56ed4-01b7-4d88-b902-a49f94814e16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:52.940870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-35c56ed4-01b7-4d88-b902-a49f94814e16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:52.950105 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-35c56ed4-01b7-4d88-b902-a49f94814e16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.178183 Sep 14 12:11:52.950690 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 347/698] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:52 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:53.263306 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-29f1332e-4abe-4088-99d5-175b81a278b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.866873 Sep 14 12:11:53.263987 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:53.264291 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 352/699] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:11:49 2022] POST /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-volume_attachments => generated 194 bytes in 3869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:11:53.264924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:53.272206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:53.272695 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:53.273134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:53.274312 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:53.274568 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:53.275820 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:53.438170 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:53.450550 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:53.452182 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:53.453539 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-605638df-ccd1-4db2-9ee6-af178dfc7cea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.196462 Sep 14 12:11:53.454491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 348/700] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:53 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:11:53.974722 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-54ac5973-2b8b-4a3b-bfd7-96726c7ec7bd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:53.975480 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-54ac5973-2b8b-4a3b-bfd7-96726c7ec7bd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:53.983233 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54ac5973-2b8b-4a3b-bfd7-96726c7ec7bd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:53.983727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54ac5973-2b8b-4a3b-bfd7-96726c7ec7bd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:53.984171 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54ac5973-2b8b-4a3b-bfd7-96726c7ec7bd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:53.984881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54ac5973-2b8b-4a3b-bfd7-96726c7ec7bd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:53.985323 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54ac5973-2b8b-4a3b-bfd7-96726c7ec7bd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:53.985745 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54ac5973-2b8b-4a3b-bfd7-96726c7ec7bd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:54.139405 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-54ac5973-2b8b-4a3b-bfd7-96726c7ec7bd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:54.148150 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-54ac5973-2b8b-4a3b-bfd7-96726c7ec7bd tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.178398 Sep 14 12:11:54.148748 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 353/701] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:53 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:54.484587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:54.484587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:54.490626 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:54.491116 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:54.491556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:54.492258 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:54.492718 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:54.493136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:54.647014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:54.656171 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:54.657691 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:54.659089 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4a84f15b-542e-41a5-ad62-4048429adb82 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.183276 Sep 14 12:11:54.659826 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 349/702] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:54 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:55.171088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b12fc1e1-1860-45de-ac9d-19153f9f517e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:55.171765 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b12fc1e1-1860-45de-ac9d-19153f9f517e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:55.178307 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b12fc1e1-1860-45de-ac9d-19153f9f517e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:55.178779 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b12fc1e1-1860-45de-ac9d-19153f9f517e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:55.179206 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b12fc1e1-1860-45de-ac9d-19153f9f517e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:55.179890 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b12fc1e1-1860-45de-ac9d-19153f9f517e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:55.180337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b12fc1e1-1860-45de-ac9d-19153f9f517e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:55.180746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b12fc1e1-1860-45de-ac9d-19153f9f517e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:55.314825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b12fc1e1-1860-45de-ac9d-19153f9f517e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:55.322389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b12fc1e1-1860-45de-ac9d-19153f9f517e tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.155174 Sep 14 12:11:55.322962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 354/703] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:55 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:55.689178 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:55.689736 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:55.696210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:55.696694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:55.697148 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:55.697833 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:55.698312 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:55.698737 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:55.830336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:55.839563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:55.841007 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:55.842211 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-760a9362-2b65-4883-8482-6cc347bc7029 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.156933 Sep 14 12:11:55.842804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 350/704] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:55 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:56.345416 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-13883cdf-b85c-4486-9d87-0e8bcc6511c3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:56.346055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-13883cdf-b85c-4486-9d87-0e8bcc6511c3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:56.352596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13883cdf-b85c-4486-9d87-0e8bcc6511c3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:56.353071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13883cdf-b85c-4486-9d87-0e8bcc6511c3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:56.353498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13883cdf-b85c-4486-9d87-0e8bcc6511c3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:56.354217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13883cdf-b85c-4486-9d87-0e8bcc6511c3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:56.354668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13883cdf-b85c-4486-9d87-0e8bcc6511c3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:56.355081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13883cdf-b85c-4486-9d87-0e8bcc6511c3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:56.497586 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-13883cdf-b85c-4486-9d87-0e8bcc6511c3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:56.505930 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-13883cdf-b85c-4486-9d87-0e8bcc6511c3 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.164233 Sep 14 12:11:56.507035 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 355/705] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:56 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:11:56.869779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:56.870410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:56.876922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:56.877419 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:56.877878 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:56.878572 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:56.879030 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:56.879460 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:57.017359 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:57.026370 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:57.027826 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:57.028996 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d1d0389a-2cf0-4928-814e-cea2d408db25 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.163174 Sep 14 12:11:57.029731 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 351/706] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:56 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:57.218264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-8e280b16-00f6-466b-a4bc-26c6a78564a0 req-879a7b6f-0e18-4217-9b34-0239f4bd7dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a00ef7-7e76-4e05-9c55-03698e3a7a9f", "name": "network-vif-plugged", "status": "completed", "tag": "c85474c8-4ecf-4baf-84fe-1fd725604066"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:11:57.228136 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-8e280b16-00f6-466b-a4bc-26c6a78564a0 req-879a7b6f-0e18-4217-9b34-0239f4bd7dba service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:57.229162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-8e280b16-00f6-466b-a4bc-26c6a78564a0 req-879a7b6f-0e18-4217-9b34-0239f4bd7dba service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:57.229595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-8e280b16-00f6-466b-a4bc-26c6a78564a0 req-879a7b6f-0e18-4217-9b34-0239f4bd7dba service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:57.243049 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-8e280b16-00f6-466b-a4bc-26c6a78564a0 req-879a7b6f-0e18-4217-9b34-0239f4bd7dba service nova] Creating event network-vif-plugged:c85474c8-4ecf-4baf-84fe-1fd725604066 for instance c3a00ef7-7e76-4e05-9c55-03698e3a7a9f on hv-cinder-84496 Sep 14 12:11:57.252778 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-8e280b16-00f6-466b-a4bc-26c6a78564a0 req-879a7b6f-0e18-4217-9b34-0239f4bd7dba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 Sep 14 12:11:57.252778 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 356/707] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:11:57.531653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6326145e-08c6-4052-9812-c7549d904ced tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:57.532237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6326145e-08c6-4052-9812-c7549d904ced tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:57.538323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6326145e-08c6-4052-9812-c7549d904ced tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:57.538973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6326145e-08c6-4052-9812-c7549d904ced tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:57.539409 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6326145e-08c6-4052-9812-c7549d904ced tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:57.540132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6326145e-08c6-4052-9812-c7549d904ced tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:57.541083 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6326145e-08c6-4052-9812-c7549d904ced tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:57.541523 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6326145e-08c6-4052-9812-c7549d904ced tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:57.736854 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6326145e-08c6-4052-9812-c7549d904ced tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:57.744684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6326145e-08c6-4052-9812-c7549d904ced tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.216882 Sep 14 12:11:57.745254 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 352/708] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:57 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:11:58.057444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:58.058182 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:58.064309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:58.064795 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:58.065241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:58.065951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:58.066407 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:58.066833 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:58.195862 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:58.205107 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:58.206571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:58.207733 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7be89702-1336-44b8-9188-eddeb3479457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.155620 Sep 14 12:11:58.208295 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 357/709] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:58 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:58.766842 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-88ccd4ce-3d9c-4f88-8de1-3b2f1e0dfc16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:58.767581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-88ccd4ce-3d9c-4f88-8de1-3b2f1e0dfc16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:58.774219 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ccd4ce-3d9c-4f88-8de1-3b2f1e0dfc16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:58.775450 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ccd4ce-3d9c-4f88-8de1-3b2f1e0dfc16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:58.775892 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ccd4ce-3d9c-4f88-8de1-3b2f1e0dfc16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:58.776591 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ccd4ce-3d9c-4f88-8de1-3b2f1e0dfc16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:58.777163 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ccd4ce-3d9c-4f88-8de1-3b2f1e0dfc16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:58.777590 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-88ccd4ce-3d9c-4f88-8de1-3b2f1e0dfc16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:58.908390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-88ccd4ce-3d9c-4f88-8de1-3b2f1e0dfc16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:58.916567 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-88ccd4ce-3d9c-4f88-8de1-3b2f1e0dfc16 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.153014 Sep 14 12:11:58.917127 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 353/710] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:58 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:11:59.232833 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:59.233546 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:59.240451 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:59.240932 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:59.241366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:59.242102 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:59.242551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:59.242968 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:59.375146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:59.383828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:59.385955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:11:59.387116 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-74973a59-39d3-41a0-a112-47886ec28c06 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.158324 Sep 14 12:11:59.387675 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 358/711] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:11:59 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:11:59.939676 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dc6b5429-cb32-431e-b707-714a8506c792 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:11:59.940328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dc6b5429-cb32-431e-b707-714a8506c792 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:11:59.946707 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dc6b5429-cb32-431e-b707-714a8506c792 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:59.947215 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dc6b5429-cb32-431e-b707-714a8506c792 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:59.947656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dc6b5429-cb32-431e-b707-714a8506c792 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:11:59.948349 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dc6b5429-cb32-431e-b707-714a8506c792 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:11:59.948806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dc6b5429-cb32-431e-b707-714a8506c792 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:11:59.949237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dc6b5429-cb32-431e-b707-714a8506c792 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:00.081256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dc6b5429-cb32-431e-b707-714a8506c792 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:00.090684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dc6b5429-cb32-431e-b707-714a8506c792 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1319 microversion: 2.1 time: 0.154934 Sep 14 12:12:00.091274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 354/712] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:11:59 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:00.412740 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:00.413375 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:00.420751 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:00.421242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:00.421680 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:00.422415 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:00.422872 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:00.423296 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:00.550302 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:00.558861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:00.560314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:00.561463 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-37644849-062d-4934-89d8-a4102b7f2166 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.152829 Sep 14 12:12:00.562045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 359/713] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:12:00 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:12:01.114167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9c9a536d-9682-4ccc-807f-795458413019 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:01.114764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9c9a536d-9682-4ccc-807f-795458413019 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:01.121309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c9a536d-9682-4ccc-807f-795458413019 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:01.121790 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c9a536d-9682-4ccc-807f-795458413019 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:01.122270 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c9a536d-9682-4ccc-807f-795458413019 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:01.122983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c9a536d-9682-4ccc-807f-795458413019 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:01.123424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c9a536d-9682-4ccc-807f-795458413019 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:01.123855 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c9a536d-9682-4ccc-807f-795458413019 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:01.253034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9c9a536d-9682-4ccc-807f-795458413019 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:01.261282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9c9a536d-9682-4ccc-807f-795458413019 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1509 microversion: 2.1 time: 0.151093 Sep 14 12:12:01.261908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 355/714] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:01 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:01.284464 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bbd5960f-c389-4248-a5f4-7ad48c5e4c67 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "090f2b21-08ad-4dce-9d08-85f3afef0d19", "device": "/dev/sdb"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:12:01.286942 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-bbd5960f-c389-4248-a5f4-7ad48c5e4c67 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:01.292887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbd5960f-c389-4248-a5f4-7ad48c5e4c67 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:01.293369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbd5960f-c389-4248-a5f4-7ad48c5e4c67 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:01.293797 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbd5960f-c389-4248-a5f4-7ad48c5e4c67 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:01.294509 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbd5960f-c389-4248-a5f4-7ad48c5e4c67 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:01.294959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbd5960f-c389-4248-a5f4-7ad48c5e4c67 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:01.295378 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bbd5960f-c389-4248-a5f4-7ad48c5e4c67 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:01.587460 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:01.588683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:01.594839 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:01.595333 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:01.595885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:01.596599 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:01.597042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:01.597469 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:01.737587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:01.747277 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:01.749608 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:01.755758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d78edcbf-8a13-4114-9c73-dc204d39ae0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.166337 Sep 14 12:12:01.755758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 356/715] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:12:01 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:12:01.971879 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-44ac6d86-8834-4e32-8aac-fca7e2554fa1 req-3b96e072-2fa5-4eff-99dc-0c09fdda8947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b1312a-8b45-4481-9a44-f330379d0c8f", "name": "network-vif-plugged", "status": "completed", "tag": "906fb0c9-14b7-4949-943a-c084b122ae8b"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:12:01.981958 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-44ac6d86-8834-4e32-8aac-fca7e2554fa1 req-3b96e072-2fa5-4eff-99dc-0c09fdda8947 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:01.982446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-44ac6d86-8834-4e32-8aac-fca7e2554fa1 req-3b96e072-2fa5-4eff-99dc-0c09fdda8947 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:01.982882 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-44ac6d86-8834-4e32-8aac-fca7e2554fa1 req-3b96e072-2fa5-4eff-99dc-0c09fdda8947 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:01.995305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-44ac6d86-8834-4e32-8aac-fca7e2554fa1 req-3b96e072-2fa5-4eff-99dc-0c09fdda8947 service nova] Creating event network-vif-plugged:906fb0c9-14b7-4949-943a-c084b122ae8b for instance b7b1312a-8b45-4481-9a44-f330379d0c8f on hv-cinder-84496 Sep 14 12:12:02.000222 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-44ac6d86-8834-4e32-8aac-fca7e2554fa1 req-3b96e072-2fa5-4eff-99dc-0c09fdda8947 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092457 Sep 14 12:12:02.000817 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 357/716] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:12:02.778508 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:02.779246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:02.786607 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:02.787096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:02.787529 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:02.788220 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:02.788670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:02.789115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:02.954524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:02.964601 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:02.966132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:02.967364 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9b2bb82d-fe86-4aae-9f9f-a510ba0212ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.194575 Sep 14 12:12:02.967913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 358/717] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:12:02 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:12:03.593227 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bbd5960f-c389-4248-a5f4-7ad48c5e4c67 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "POST /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.312463 Sep 14 12:12:03.598271 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 360/718] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:12:01 2022] POST /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f/os-volume_attachments => generated 194 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:12:03.992617 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:03.993197 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:04.004451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:04.005083 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:04.005523 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:04.006267 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:04.006989 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:04.007139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:04.140971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:04.149541 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:04.151760 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:04.152927 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-820d0b78-b11d-40bd-be5f-2cfe2b0b385f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.164335 Sep 14 12:12:04.158263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 359/719] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:12:03 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:12:05.138394 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2bfd8235-46c3-40a8-b0c8-4885ff6f5939 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: .version_select at 0x7f1c99d114c0>, body: {"keypair": {"name": "tempest-keypair-1361228140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBjPyU9UNHd0RN1vjb2owfGNAj/MDCRzV2A8imLpguKwc2yeszq8A6eLZ+riLeFXHTSv8vH0hXx0ksq6FcCaDAhll90XWAOIwtzBamgH0ooxHRUpGblCbvTQweXeLIZEQ=="}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:12:05.155407 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-2bfd8235-46c3-40a8-b0c8-4885ff6f5939 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for project 5b86ec91335c49aaa672aa85461d2936. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:12:05.160446 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-2bfd8235-46c3-40a8-b0c8-4885ff6f5939 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for user 31f3271adc36406fb303fb169020e740 and project 5b86ec91335c49aaa672aa85461d2936. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:12:05.178504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:05.179115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:05.185518 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:05.186042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:05.186483 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:05.187174 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:05.187624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:05.188053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:05.250512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2bfd8235-46c3-40a8-b0c8-4885ff6f5939 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117334 Sep 14 12:12:05.251307 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 361/720] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 14 12:12:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:12:05.318096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:05.327132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:05.328559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:05.329713 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5996f847-fc63-40e7-9df9-3a078eff95e3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.155113 Sep 14 12:12:05.330304 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 360/721] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:12:05 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:12:06.356647 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:06.357387 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:06.364147 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:06.364636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:06.365096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:06.365795 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:06.366275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:06.366687 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:06.369908 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:06.732035 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:06.742790 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:06.744488 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:06.746772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2fe72aed-1293-401b-a023-1cc4d65a3d63 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.395598 Sep 14 12:12:06.747532 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 362/722] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:12:06 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:12:07.773970 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:07.775275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:07.782082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:07.782579 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:07.783054 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:07.783757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:07.784210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:07.784662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:07.790393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-508725243", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf307d40-f42c-4be6-8979-65e762517b0f"}], "security_groups": [{"name": "tempest-securitygroup--1442193097"}], "key_name": "tempest-keypair-1361228140", "user_data": "}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:12:07.961559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.network.neutron [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] validate_networks() for [('cf307d40-f42c-4be6-8979-65e762517b0f', None, None, None, None, None)] {{(pid=121152) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:12:07.965442 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:07.974594 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:07.976018 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:07.977181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-170ddc5b-7441-46ef-b795-81f4ede369ea tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1808 microversion: 2.20 time: 0.207816 Sep 14 12:12:07.977739 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 361/723] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:12:07 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:12:08.349713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Flavor limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:12:08.350197 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Image limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:12:08.350672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Flavor pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:12:08.351083 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Image pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:12:08.351498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:12:08.360872 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:08.361351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:08.361786 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:08.362555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:08.363009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:08.363446 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:08.379743 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for project 5b86ec91335c49aaa672aa85461d2936. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:12:08.383704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for user 31f3271adc36406fb303fb169020e740 and project 5b86ec91335c49aaa672aa85461d2936. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:12:08.394744 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Going to run 1 instances... {{(pid=121152) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:12:08.397038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:12:08.519494 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-640dc3c5-5bbd-4117-99b2-70e1f4741f63 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.734166 Sep 14 12:12:08.520248 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 363/724] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:12:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 12:12:08.532183 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7663a789-fb75-48f2-a803-573d5c52fba4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:08.532786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7663a789-fb75-48f2-a803-573d5c52fba4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:08.584848 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7663a789-fb75-48f2-a803-573d5c52fba4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:08.592287 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7663a789-fb75-48f2-a803-573d5c52fba4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1241 microversion: 2.1 time: 0.064019 Sep 14 12:12:08.592860 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 362/725] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:08 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:09.003788 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:09.004425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:09.010571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:09.011057 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:09.011497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:09.012215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:09.012843 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:09.013274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:09.146272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:09.156005 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:09.157491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:09.158689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-67fe73d6-0f1b-4814-805a-ff99202bd12b tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1795 microversion: 2.20 time: 0.159524 Sep 14 12:12:09.159263 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 364/726] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:12:08 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:12:09.614649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-49476651-a34a-402f-94a3-c665a4c6813c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:09.615256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-49476651-a34a-402f-94a3-c665a4c6813c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:09.622878 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-49476651-a34a-402f-94a3-c665a4c6813c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:09.623360 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-49476651-a34a-402f-94a3-c665a4c6813c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:09.623800 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-49476651-a34a-402f-94a3-c665a4c6813c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:09.624490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-49476651-a34a-402f-94a3-c665a4c6813c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:09.624937 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-49476651-a34a-402f-94a3-c665a4c6813c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:09.625435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-49476651-a34a-402f-94a3-c665a4c6813c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:09.686459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-49476651-a34a-402f-94a3-c665a4c6813c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:09.694168 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-49476651-a34a-402f-94a3-c665a4c6813c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1245 microversion: 2.1 time: 0.083277 Sep 14 12:12:09.694736 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 363/727] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:09 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:10.718281 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0aa6213d-5b18-4167-b39f-7df9e996b4d6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:10.719037 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0aa6213d-5b18-4167-b39f-7df9e996b4d6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:10.727105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0aa6213d-5b18-4167-b39f-7df9e996b4d6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:10.727685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0aa6213d-5b18-4167-b39f-7df9e996b4d6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:10.728215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0aa6213d-5b18-4167-b39f-7df9e996b4d6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:10.729686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0aa6213d-5b18-4167-b39f-7df9e996b4d6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:10.730266 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0aa6213d-5b18-4167-b39f-7df9e996b4d6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:10.730794 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0aa6213d-5b18-4167-b39f-7df9e996b4d6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:10.802408 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0aa6213d-5b18-4167-b39f-7df9e996b4d6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:10.812250 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0aa6213d-5b18-4167-b39f-7df9e996b4d6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1293 microversion: 2.1 time: 0.099247 Sep 14 12:12:10.812829 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 365/728] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:10 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:11.835212 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-62088b67-ab51-440e-bcf2-cc3b43fcf91b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:11.835831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-62088b67-ab51-440e-bcf2-cc3b43fcf91b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:11.842063 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=66 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:11.843178 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62088b67-ab51-440e-bcf2-cc3b43fcf91b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:11.843669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62088b67-ab51-440e-bcf2-cc3b43fcf91b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:11.844114 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62088b67-ab51-440e-bcf2-cc3b43fcf91b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:11.844816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62088b67-ab51-440e-bcf2-cc3b43fcf91b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:11.845275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62088b67-ab51-440e-bcf2-cc3b43fcf91b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:11.845705 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62088b67-ab51-440e-bcf2-cc3b43fcf91b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:12.080616 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-62088b67-ab51-440e-bcf2-cc3b43fcf91b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:12.085503 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-62088b67-ab51-440e-bcf2-cc3b43fcf91b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.254251 Sep 14 12:12:12.097075 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 364/729] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:11 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:13.054064 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-30fb03d5-a2c6-409e-9ed2-2a6a35a35426 req-95a0c8db-9887-465c-8591-8d400ebe3a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fe551f-effb-4a0a-b0c2-b4bc82178953", "tag": "d4d61e40-b11d-4281-b965-9796c5ee7fce"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:12:13.064794 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-30fb03d5-a2c6-409e-9ed2-2a6a35a35426 req-95a0c8db-9887-465c-8591-8d400ebe3a0b service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:13.065268 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-30fb03d5-a2c6-409e-9ed2-2a6a35a35426 req-95a0c8db-9887-465c-8591-8d400ebe3a0b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:13.065699 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-30fb03d5-a2c6-409e-9ed2-2a6a35a35426 req-95a0c8db-9887-465c-8591-8d400ebe3a0b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:13.077985 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-30fb03d5-a2c6-409e-9ed2-2a6a35a35426 req-95a0c8db-9887-465c-8591-8d400ebe3a0b service nova] Creating event network-changed:d4d61e40-b11d-4281-b965-9796c5ee7fce for instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 on hv-cinder-84496 Sep 14 12:12:13.082928 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-30fb03d5-a2c6-409e-9ed2-2a6a35a35426 req-95a0c8db-9887-465c-8591-8d400ebe3a0b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032596 Sep 14 12:12:13.083559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 366/730] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:12:13.110261 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7082f556-b726-4cc1-989d-9e363c457afd tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:13.110880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7082f556-b726-4cc1-989d-9e363c457afd tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:13.117641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7082f556-b726-4cc1-989d-9e363c457afd tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:13.118167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7082f556-b726-4cc1-989d-9e363c457afd tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:13.118818 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7082f556-b726-4cc1-989d-9e363c457afd tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:13.120623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7082f556-b726-4cc1-989d-9e363c457afd tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:13.121601 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7082f556-b726-4cc1-989d-9e363c457afd tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:13.122347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7082f556-b726-4cc1-989d-9e363c457afd tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:13.129850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:13.317307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7082f556-b726-4cc1-989d-9e363c457afd tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:13.325600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7082f556-b726-4cc1-989d-9e363c457afd tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.219338 Sep 14 12:12:13.326217 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 365/731] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:13 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:14.349648 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7eda2b93-5467-4fb4-b20d-593fccbeabb7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:14.350613 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7eda2b93-5467-4fb4-b20d-593fccbeabb7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:14.353685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:14.377178 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7eda2b93-5467-4fb4-b20d-593fccbeabb7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:14.377750 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7eda2b93-5467-4fb4-b20d-593fccbeabb7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:14.378289 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7eda2b93-5467-4fb4-b20d-593fccbeabb7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:14.379067 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7eda2b93-5467-4fb4-b20d-593fccbeabb7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:14.379620 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7eda2b93-5467-4fb4-b20d-593fccbeabb7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:14.380125 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7eda2b93-5467-4fb4-b20d-593fccbeabb7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:14.523308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7eda2b93-5467-4fb4-b20d-593fccbeabb7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:14.531705 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7eda2b93-5467-4fb4-b20d-593fccbeabb7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.186830 Sep 14 12:12:14.532271 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 367/732] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:14 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:15.555294 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4219b3f0-11a9-4597-95b5-06f1cf8c1a5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:15.555978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4219b3f0-11a9-4597-95b5-06f1cf8c1a5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:15.562904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4219b3f0-11a9-4597-95b5-06f1cf8c1a5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:15.563387 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4219b3f0-11a9-4597-95b5-06f1cf8c1a5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:15.563824 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4219b3f0-11a9-4597-95b5-06f1cf8c1a5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:15.564514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4219b3f0-11a9-4597-95b5-06f1cf8c1a5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:15.564965 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4219b3f0-11a9-4597-95b5-06f1cf8c1a5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:15.565389 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4219b3f0-11a9-4597-95b5-06f1cf8c1a5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:15.693190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4219b3f0-11a9-4597-95b5-06f1cf8c1a5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:15.700828 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4219b3f0-11a9-4597-95b5-06f1cf8c1a5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.149508 Sep 14 12:12:15.701386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 366/733] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:15 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:12:16.723868 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a25d9f07-28ab-4105-a947-770a5ba9ffdb tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:16.724456 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a25d9f07-28ab-4105-a947-770a5ba9ffdb tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:16.731413 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a25d9f07-28ab-4105-a947-770a5ba9ffdb tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:16.731898 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a25d9f07-28ab-4105-a947-770a5ba9ffdb tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:16.732392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a25d9f07-28ab-4105-a947-770a5ba9ffdb tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:16.733084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a25d9f07-28ab-4105-a947-770a5ba9ffdb tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:16.733541 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a25d9f07-28ab-4105-a947-770a5ba9ffdb tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:16.734001 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a25d9f07-28ab-4105-a947-770a5ba9ffdb tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:16.866498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a25d9f07-28ab-4105-a947-770a5ba9ffdb tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:16.874186 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a25d9f07-28ab-4105-a947-770a5ba9ffdb tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.154685 Sep 14 12:12:16.874750 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 368/734] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:16 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:17.897051 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c49fae37-e259-4fdb-91ab-36f6ba810606 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:17.897755 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c49fae37-e259-4fdb-91ab-36f6ba810606 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:17.904802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c49fae37-e259-4fdb-91ab-36f6ba810606 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:17.905296 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c49fae37-e259-4fdb-91ab-36f6ba810606 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:17.905773 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c49fae37-e259-4fdb-91ab-36f6ba810606 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:17.906521 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c49fae37-e259-4fdb-91ab-36f6ba810606 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:17.906981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c49fae37-e259-4fdb-91ab-36f6ba810606 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:17.907412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c49fae37-e259-4fdb-91ab-36f6ba810606 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:18.041811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c49fae37-e259-4fdb-91ab-36f6ba810606 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:18.049403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c49fae37-e259-4fdb-91ab-36f6ba810606 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.156826 Sep 14 12:12:18.050005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 367/735] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:17 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:19.073437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-34589ddb-ad84-4af1-8ddb-1b944d20cbc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:19.074098 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-34589ddb-ad84-4af1-8ddb-1b944d20cbc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:19.076397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:19.077061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=10 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:19.082084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-34589ddb-ad84-4af1-8ddb-1b944d20cbc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:19.082571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-34589ddb-ad84-4af1-8ddb-1b944d20cbc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:19.083008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-34589ddb-ad84-4af1-8ddb-1b944d20cbc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:19.083726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-34589ddb-ad84-4af1-8ddb-1b944d20cbc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:19.084181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-34589ddb-ad84-4af1-8ddb-1b944d20cbc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:19.084612 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-34589ddb-ad84-4af1-8ddb-1b944d20cbc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:19.215764 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-34589ddb-ad84-4af1-8ddb-1b944d20cbc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:19.223359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-34589ddb-ad84-4af1-8ddb-1b944d20cbc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.153873 Sep 14 12:12:19.223937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 369/736] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:19 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:20.246971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-40696351-b679-41c8-9191-9a752394908c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:20.247585 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-40696351-b679-41c8-9191-9a752394908c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:20.249403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:20.255086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40696351-b679-41c8-9191-9a752394908c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:20.255628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40696351-b679-41c8-9191-9a752394908c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:20.256074 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40696351-b679-41c8-9191-9a752394908c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:20.256766 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40696351-b679-41c8-9191-9a752394908c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:20.257226 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40696351-b679-41c8-9191-9a752394908c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:20.257647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-40696351-b679-41c8-9191-9a752394908c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:20.393259 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-40696351-b679-41c8-9191-9a752394908c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:20.403365 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-40696351-b679-41c8-9191-9a752394908c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.160742 Sep 14 12:12:20.403982 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 368/737] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:20 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:21.427685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4438041e-af73-4779-b865-b85adc412d5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:21.428315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4438041e-af73-4779-b865-b85adc412d5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:21.435515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4438041e-af73-4779-b865-b85adc412d5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:21.439777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4438041e-af73-4779-b865-b85adc412d5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:21.439777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4438041e-af73-4779-b865-b85adc412d5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:21.439777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4438041e-af73-4779-b865-b85adc412d5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:21.439777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4438041e-af73-4779-b865-b85adc412d5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:21.440398 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4438041e-af73-4779-b865-b85adc412d5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:21.570134 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4438041e-af73-4779-b865-b85adc412d5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:21.578062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4438041e-af73-4779-b865-b85adc412d5e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.154374 Sep 14 12:12:21.581780 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 370/738] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:21 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:22.603114 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4dc8866c-fa42-4848-b9e4-0e525b689762 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:22.603850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4dc8866c-fa42-4848-b9e4-0e525b689762 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:22.610319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4dc8866c-fa42-4848-b9e4-0e525b689762 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:22.610810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4dc8866c-fa42-4848-b9e4-0e525b689762 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:22.611245 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4dc8866c-fa42-4848-b9e4-0e525b689762 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:22.611973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4dc8866c-fa42-4848-b9e4-0e525b689762 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:22.612435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4dc8866c-fa42-4848-b9e4-0e525b689762 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:22.612855 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4dc8866c-fa42-4848-b9e4-0e525b689762 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:22.741673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4dc8866c-fa42-4848-b9e4-0e525b689762 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:22.749345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4dc8866c-fa42-4848-b9e4-0e525b689762 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.150309 Sep 14 12:12:22.749952 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 369/739] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:22 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:23.772202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-18396104-6ade-4d9e-aa9e-9494894d2fd7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:23.772812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-18396104-6ade-4d9e-aa9e-9494894d2fd7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:23.779648 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18396104-6ade-4d9e-aa9e-9494894d2fd7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:23.780130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18396104-6ade-4d9e-aa9e-9494894d2fd7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:23.780560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18396104-6ade-4d9e-aa9e-9494894d2fd7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:23.781245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18396104-6ade-4d9e-aa9e-9494894d2fd7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:23.781692 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18396104-6ade-4d9e-aa9e-9494894d2fd7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:23.782167 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18396104-6ade-4d9e-aa9e-9494894d2fd7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:23.914998 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-18396104-6ade-4d9e-aa9e-9494894d2fd7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:23.923173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-18396104-6ade-4d9e-aa9e-9494894d2fd7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.154821 Sep 14 12:12:23.923752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 371/740] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:23 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:24.946974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d6488580-2f72-44df-a2c1-4f7b40b639e4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:24.947638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d6488580-2f72-44df-a2c1-4f7b40b639e4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:24.954108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6488580-2f72-44df-a2c1-4f7b40b639e4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:24.954587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6488580-2f72-44df-a2c1-4f7b40b639e4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:24.955025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6488580-2f72-44df-a2c1-4f7b40b639e4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:24.955731 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6488580-2f72-44df-a2c1-4f7b40b639e4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:24.956181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6488580-2f72-44df-a2c1-4f7b40b639e4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:24.956604 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6488580-2f72-44df-a2c1-4f7b40b639e4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:25.086068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d6488580-2f72-44df-a2c1-4f7b40b639e4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:25.093551 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d6488580-2f72-44df-a2c1-4f7b40b639e4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.150621 Sep 14 12:12:25.094145 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 370/741] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:24 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:12:26.116638 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f86a621d-65fc-4c4b-afa0-c95bfbd01101 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:26.117260 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f86a621d-65fc-4c4b-afa0-c95bfbd01101 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:26.124982 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f86a621d-65fc-4c4b-afa0-c95bfbd01101 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:26.125507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f86a621d-65fc-4c4b-afa0-c95bfbd01101 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:26.125977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f86a621d-65fc-4c4b-afa0-c95bfbd01101 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:26.126696 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f86a621d-65fc-4c4b-afa0-c95bfbd01101 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:26.127151 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f86a621d-65fc-4c4b-afa0-c95bfbd01101 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:26.127570 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f86a621d-65fc-4c4b-afa0-c95bfbd01101 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:26.270491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f86a621d-65fc-4c4b-afa0-c95bfbd01101 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:26.278611 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f86a621d-65fc-4c4b-afa0-c95bfbd01101 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.165829 Sep 14 12:12:26.279183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 372/742] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:26 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:27.302078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-810b1fe4-dcfa-486d-86e8-3ae88ae339b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:27.302720 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-810b1fe4-dcfa-486d-86e8-3ae88ae339b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:27.309552 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-810b1fe4-dcfa-486d-86e8-3ae88ae339b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:27.310067 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-810b1fe4-dcfa-486d-86e8-3ae88ae339b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:27.310503 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-810b1fe4-dcfa-486d-86e8-3ae88ae339b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:27.311197 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-810b1fe4-dcfa-486d-86e8-3ae88ae339b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:27.311648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-810b1fe4-dcfa-486d-86e8-3ae88ae339b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:27.312071 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-810b1fe4-dcfa-486d-86e8-3ae88ae339b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:27.446845 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-810b1fe4-dcfa-486d-86e8-3ae88ae339b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:27.455175 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-810b1fe4-dcfa-486d-86e8-3ae88ae339b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.157035 Sep 14 12:12:27.455741 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 371/743] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:27 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:28.478513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4c44f973-7f2f-474f-9322-3923f4f5c76b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:28.479620 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4c44f973-7f2f-474f-9322-3923f4f5c76b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:28.486301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c44f973-7f2f-474f-9322-3923f4f5c76b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:28.486783 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c44f973-7f2f-474f-9322-3923f4f5c76b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:28.487220 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c44f973-7f2f-474f-9322-3923f4f5c76b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:28.487945 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c44f973-7f2f-474f-9322-3923f4f5c76b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:28.488399 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c44f973-7f2f-474f-9322-3923f4f5c76b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:28.488823 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4c44f973-7f2f-474f-9322-3923f4f5c76b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:28.627214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4c44f973-7f2f-474f-9322-3923f4f5c76b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:28.640127 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4c44f973-7f2f-474f-9322-3923f4f5c76b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.160304 Sep 14 12:12:28.640127 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 373/744] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:28 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:29.659354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d6a61518-3072-465b-a997-7437ac383836 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:29.660013 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d6a61518-3072-465b-a997-7437ac383836 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:29.666384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6a61518-3072-465b-a997-7437ac383836 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:29.670623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6a61518-3072-465b-a997-7437ac383836 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:29.670623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6a61518-3072-465b-a997-7437ac383836 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:29.670623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6a61518-3072-465b-a997-7437ac383836 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:29.670623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6a61518-3072-465b-a997-7437ac383836 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:29.671005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6a61518-3072-465b-a997-7437ac383836 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:29.803031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d6a61518-3072-465b-a997-7437ac383836 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:29.811703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d6a61518-3072-465b-a997-7437ac383836 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.156252 Sep 14 12:12:29.812284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 372/745] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:29 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:30.506085 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-cc5e921b-ae09-474c-b0ac-1b9fd22c4507 req-90f1b404-cbc8-4872-8658-0f7fe82f0798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fe551f-effb-4a0a-b0c2-b4bc82178953", "name": "network-vif-plugged", "status": "completed", "tag": "d4d61e40-b11d-4281-b965-9796c5ee7fce"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:12:30.516825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-cc5e921b-ae09-474c-b0ac-1b9fd22c4507 req-90f1b404-cbc8-4872-8658-0f7fe82f0798 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:30.521588 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-cc5e921b-ae09-474c-b0ac-1b9fd22c4507 req-90f1b404-cbc8-4872-8658-0f7fe82f0798 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:30.521588 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-cc5e921b-ae09-474c-b0ac-1b9fd22c4507 req-90f1b404-cbc8-4872-8658-0f7fe82f0798 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:30.530217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-cc5e921b-ae09-474c-b0ac-1b9fd22c4507 req-90f1b404-cbc8-4872-8658-0f7fe82f0798 service nova] Creating event network-vif-plugged:d4d61e40-b11d-4281-b965-9796c5ee7fce for instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 on hv-cinder-84496 Sep 14 12:12:30.535458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-cc5e921b-ae09-474c-b0ac-1b9fd22c4507 req-90f1b404-cbc8-4872-8658-0f7fe82f0798 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033496 Sep 14 12:12:30.536179 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 374/746] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:12:30.835167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-83f21a1a-27b1-461b-b1a8-69ec569f8bde tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:30.835766 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-83f21a1a-27b1-461b-b1a8-69ec569f8bde tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:30.843313 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83f21a1a-27b1-461b-b1a8-69ec569f8bde tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:30.847263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83f21a1a-27b1-461b-b1a8-69ec569f8bde tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:30.847263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83f21a1a-27b1-461b-b1a8-69ec569f8bde tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:30.847263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83f21a1a-27b1-461b-b1a8-69ec569f8bde tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:30.847263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83f21a1a-27b1-461b-b1a8-69ec569f8bde tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:30.847643 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83f21a1a-27b1-461b-b1a8-69ec569f8bde tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:30.983521 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-83f21a1a-27b1-461b-b1a8-69ec569f8bde tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:30.991397 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-83f21a1a-27b1-461b-b1a8-69ec569f8bde tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.160332 Sep 14 12:12:30.991992 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 373/747] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:30 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:32.016125 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-28eb913f-c11b-4827-a7a5-b1a34dd1b9b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:32.019538 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-28eb913f-c11b-4827-a7a5-b1a34dd1b9b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:32.023670 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28eb913f-c11b-4827-a7a5-b1a34dd1b9b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:32.024164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28eb913f-c11b-4827-a7a5-b1a34dd1b9b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:32.024859 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28eb913f-c11b-4827-a7a5-b1a34dd1b9b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:32.025565 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28eb913f-c11b-4827-a7a5-b1a34dd1b9b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:32.026227 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28eb913f-c11b-4827-a7a5-b1a34dd1b9b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:32.026660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-28eb913f-c11b-4827-a7a5-b1a34dd1b9b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:32.168327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-28eb913f-c11b-4827-a7a5-b1a34dd1b9b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:32.177087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-28eb913f-c11b-4827-a7a5-b1a34dd1b9b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.165572 Sep 14 12:12:32.177944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 375/748] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:32 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:33.203462 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-512403dc-8ac4-4c1d-ba43-125440330b35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:33.204161 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-512403dc-8ac4-4c1d-ba43-125440330b35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:33.206446 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2d14463c-92b1-4944-9808-6641775357d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:33.206912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2d14463c-92b1-4944-9808-6641775357d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:33.210263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-512403dc-8ac4-4c1d-ba43-125440330b35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:33.210756 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-512403dc-8ac4-4c1d-ba43-125440330b35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:33.211196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-512403dc-8ac4-4c1d-ba43-125440330b35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:33.211895 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-512403dc-8ac4-4c1d-ba43-125440330b35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:33.212363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-512403dc-8ac4-4c1d-ba43-125440330b35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:33.212806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-512403dc-8ac4-4c1d-ba43-125440330b35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:33.213744 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d14463c-92b1-4944-9808-6641775357d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:33.214272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d14463c-92b1-4944-9808-6641775357d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:33.214719 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d14463c-92b1-4944-9808-6641775357d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:33.215415 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d14463c-92b1-4944-9808-6641775357d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:33.215870 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d14463c-92b1-4944-9808-6641775357d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:33.216294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d14463c-92b1-4944-9808-6641775357d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:33.302241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-2d14463c-92b1-4944-9808-6641775357d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lazy-loading 'services' on Instance uuid c3a00ef7-7e76-4e05-9c55-03698e3a7a9f {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:12:33.357246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-512403dc-8ac4-4c1d-ba43-125440330b35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:33.365424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-512403dc-8ac4-4c1d-ba43-125440330b35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1367 microversion: 2.1 time: 0.168763 Sep 14 12:12:33.366061 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 374/749] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:33 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:33.608586 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2d14463c-92b1-4944-9808-6641775357d6 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f/os-volume_attachments/090f2b21-08ad-4dce-9d08-85f3afef0d19" status: 202 len: 0 microversion: 2.1 time: 0.405961 Sep 14 12:12:33.609186 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 376/750] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:12:33 2022] DELETE /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f/os-volume_attachments/090f2b21-08ad-4dce-9d08-85f3afef0d19 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:12:34.388377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dca45829-d2c6-4fbe-a717-542f38194929 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:34.388989 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dca45829-d2c6-4fbe-a717-542f38194929 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:34.395714 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dca45829-d2c6-4fbe-a717-542f38194929 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:34.406395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dca45829-d2c6-4fbe-a717-542f38194929 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:34.406395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dca45829-d2c6-4fbe-a717-542f38194929 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:34.406395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dca45829-d2c6-4fbe-a717-542f38194929 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:34.406395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dca45829-d2c6-4fbe-a717-542f38194929 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:34.406800 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dca45829-d2c6-4fbe-a717-542f38194929 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:34.529194 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dca45829-d2c6-4fbe-a717-542f38194929 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:34.541399 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dca45829-d2c6-4fbe-a717-542f38194929 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1557 microversion: 2.1 time: 0.156543 Sep 14 12:12:34.542270 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 375/751] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:34 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:34.572491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2928e47b-c6e5-491a-a826-7385825c4620 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:34.573094 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2928e47b-c6e5-491a-a826-7385825c4620 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:34.579786 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2928e47b-c6e5-491a-a826-7385825c4620 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:34.580317 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2928e47b-c6e5-491a-a826-7385825c4620 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:34.580754 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2928e47b-c6e5-491a-a826-7385825c4620 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:34.581452 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2928e47b-c6e5-491a-a826-7385825c4620 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:34.581939 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2928e47b-c6e5-491a-a826-7385825c4620 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:34.582384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2928e47b-c6e5-491a-a826-7385825c4620 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:34.663820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2928e47b-c6e5-491a-a826-7385825c4620 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096129 Sep 14 12:12:34.664396 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 377/752] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 14 12:12:34 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:12:35.791131 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-26c35852-60f9-47d2-96b0-91e53ec4a6a4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:35.791908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-26c35852-60f9-47d2-96b0-91e53ec4a6a4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:35.799061 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26c35852-60f9-47d2-96b0-91e53ec4a6a4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:35.799548 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26c35852-60f9-47d2-96b0-91e53ec4a6a4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:35.799983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26c35852-60f9-47d2-96b0-91e53ec4a6a4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:35.800678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26c35852-60f9-47d2-96b0-91e53ec4a6a4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:35.801198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26c35852-60f9-47d2-96b0-91e53ec4a6a4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:35.801928 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26c35852-60f9-47d2-96b0-91e53ec4a6a4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:35.830972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-26c35852-60f9-47d2-96b0-91e53ec4a6a4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:12:35.929634 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-3e3de830-a64a-4061-938b-7e795770c4b4 req-520cf8c0-23a6-44a2-a385-84c3dadb053d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fe551f-effb-4a0a-b0c2-b4bc82178953", "tag": "d4d61e40-b11d-4281-b965-9796c5ee7fce"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:12:35.940516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-3e3de830-a64a-4061-938b-7e795770c4b4 req-520cf8c0-23a6-44a2-a385-84c3dadb053d service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:35.940995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-3e3de830-a64a-4061-938b-7e795770c4b4 req-520cf8c0-23a6-44a2-a385-84c3dadb053d service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:35.941417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-3e3de830-a64a-4061-938b-7e795770c4b4 req-520cf8c0-23a6-44a2-a385-84c3dadb053d service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:35.956505 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-3e3de830-a64a-4061-938b-7e795770c4b4 req-520cf8c0-23a6-44a2-a385-84c3dadb053d service nova] Creating event network-changed:d4d61e40-b11d-4281-b965-9796c5ee7fce for instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 on hv-cinder-84496 Sep 14 12:12:35.961412 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-3e3de830-a64a-4061-938b-7e795770c4b4 req-520cf8c0-23a6-44a2-a385-84c3dadb053d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040625 Sep 14 12:12:35.962229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 378/753] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:12:36.268633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-26c35852-60f9-47d2-96b0-91e53ec4a6a4 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 204 len: 0 microversion: 2.1 time: 0.480804 Sep 14 12:12:36.270250 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 376/754] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:12:35 2022] DELETE /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 12:12:36.284157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d6e4886f-3973-48ba-9498-1e40b34c1f77 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:36.284999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d6e4886f-3973-48ba-9498-1e40b34c1f77 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:36.291271 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6e4886f-3973-48ba-9498-1e40b34c1f77 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:36.291856 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6e4886f-3973-48ba-9498-1e40b34c1f77 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:36.292376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6e4886f-3973-48ba-9498-1e40b34c1f77 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:36.293079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6e4886f-3973-48ba-9498-1e40b34c1f77 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:36.293525 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6e4886f-3973-48ba-9498-1e40b34c1f77 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:36.294008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6e4886f-3973-48ba-9498-1e40b34c1f77 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:36.442875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d6e4886f-3973-48ba-9498-1e40b34c1f77 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:36.452342 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d6e4886f-3973-48ba-9498-1e40b34c1f77 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1515 microversion: 2.1 time: 0.175145 Sep 14 12:12:36.452850 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 379/755] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:36 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:37.477480 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b10b2d7b-9c4c-4d43-b3c4-ea532458bd91 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:37.478210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b10b2d7b-9c4c-4d43-b3c4-ea532458bd91 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:37.485539 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b10b2d7b-9c4c-4d43-b3c4-ea532458bd91 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:37.486115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b10b2d7b-9c4c-4d43-b3c4-ea532458bd91 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:37.486699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b10b2d7b-9c4c-4d43-b3c4-ea532458bd91 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:37.487420 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b10b2d7b-9c4c-4d43-b3c4-ea532458bd91 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:37.487879 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b10b2d7b-9c4c-4d43-b3c4-ea532458bd91 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:37.488370 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b10b2d7b-9c4c-4d43-b3c4-ea532458bd91 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:37.630435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b10b2d7b-9c4c-4d43-b3c4-ea532458bd91 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:37.638393 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b10b2d7b-9c4c-4d43-b3c4-ea532458bd91 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1515 microversion: 2.1 time: 0.165156 Sep 14 12:12:37.638986 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 377/756] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:37 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:38.663056 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e0ef65f0-967a-4984-97ab-3952dc2d6c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:38.663806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e0ef65f0-967a-4984-97ab-3952dc2d6c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:38.670887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e0ef65f0-967a-4984-97ab-3952dc2d6c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:38.671370 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e0ef65f0-967a-4984-97ab-3952dc2d6c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:38.673952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e0ef65f0-967a-4984-97ab-3952dc2d6c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:38.673952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e0ef65f0-967a-4984-97ab-3952dc2d6c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:38.673952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e0ef65f0-967a-4984-97ab-3952dc2d6c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:38.673952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e0ef65f0-967a-4984-97ab-3952dc2d6c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:38.676245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:38.806531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e0ef65f0-967a-4984-97ab-3952dc2d6c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:38.815564 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e0ef65f0-967a-4984-97ab-3952dc2d6c0c tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1515 microversion: 2.1 time: 0.156670 Sep 14 12:12:38.816173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 380/757] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:38 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:39.708155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-0e58e30d-a74d-4642-9bbf-61b749304580 req-5a92fc7b-6a93-4b65-b205-331ec298e2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a00ef7-7e76-4e05-9c55-03698e3a7a9f", "name": "network-vif-deleted", "tag": "c85474c8-4ecf-4baf-84fe-1fd725604066"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:12:39.718946 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0e58e30d-a74d-4642-9bbf-61b749304580 req-5a92fc7b-6a93-4b65-b205-331ec298e2c1 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:39.719431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0e58e30d-a74d-4642-9bbf-61b749304580 req-5a92fc7b-6a93-4b65-b205-331ec298e2c1 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:39.719861 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0e58e30d-a74d-4642-9bbf-61b749304580 req-5a92fc7b-6a93-4b65-b205-331ec298e2c1 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:39.730848 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-0e58e30d-a74d-4642-9bbf-61b749304580 req-5a92fc7b-6a93-4b65-b205-331ec298e2c1 service nova] Creating event network-vif-deleted:c85474c8-4ecf-4baf-84fe-1fd725604066 for instance c3a00ef7-7e76-4e05-9c55-03698e3a7a9f on hv-cinder-84496 Sep 14 12:12:39.736128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-0e58e30d-a74d-4642-9bbf-61b749304580 req-5a92fc7b-6a93-4b65-b205-331ec298e2c1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031639 Sep 14 12:12:39.736730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 378/758] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:12:39.838239 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-414f5ad4-a0da-46f9-8200-e7b6a7009d33 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:39.838999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-414f5ad4-a0da-46f9-8200-e7b6a7009d33 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:39.845378 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-414f5ad4-a0da-46f9-8200-e7b6a7009d33 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:39.845877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-414f5ad4-a0da-46f9-8200-e7b6a7009d33 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:39.846314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-414f5ad4-a0da-46f9-8200-e7b6a7009d33 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:39.846998 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-414f5ad4-a0da-46f9-8200-e7b6a7009d33 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:39.847445 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-414f5ad4-a0da-46f9-8200-e7b6a7009d33 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:39.847860 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-414f5ad4-a0da-46f9-8200-e7b6a7009d33 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:39.913525 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-414f5ad4-a0da-46f9-8200-e7b6a7009d33 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:39.921411 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-414f5ad4-a0da-46f9-8200-e7b6a7009d33 tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1473 microversion: 2.1 time: 0.087062 Sep 14 12:12:39.922026 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 381/759] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:39 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1473 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:40.945981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:40.946672 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:40.956295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:40.956786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:40.957218 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:40.957979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:40.958431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:40.958853 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:40.991724 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:40.992222 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:40.992744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:40.993356 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lazy-loading 'fault' on Instance uuid c3a00ef7-7e76-4e05-9c55-03698e3a7a9f {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:12:41.036014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe575351bdc456682db592f0c723ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1488f00baa934f2e9b910644a179c755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:12:41.043652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-333f6b1b-29ee-4733-94a9-b54032ab3b3a tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 200 len: 1309 microversion: 2.1 time: 0.101889 Sep 14 12:12:41.044210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 379/760] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:40 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:12:42.066436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:12:42.067044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] [instance: c3a00ef7-7e76-4e05-9c55-03698e3a7a9f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:42.073502 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:42.074018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:42.074518 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:42.075127 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:42.075575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:42.075990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:42.089144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] HTTP exception thrown: Instance c3a00ef7-7e76-4e05-9c55-03698e3a7a9f could not be found. Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Request method failure captured: Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f HTTP/1.1 Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcRDam_B3cGv6YC9dKVpW4P0kmPIIiFlnb8buXemlMunpM3IED6Nq_e9i-I-ck_IxbvbHQtj2jg4JMqZ2uaE4xeFy1SrAnGPvbbU22HjiZj-2KkNzmSCmFKP8ONtnU42-cbxXeeQF9JheswZXWDic5WHqd_G2nGEo6izlepBBNkrfPg Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 1488f00baa934f2e9b910644a179c755 Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1737726883 Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:12:42.092812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1488f00baa934f2e9b910644a179c755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1488f00baa934f2e9b910644a179c755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1488f00baa934f2e9b910644a179c755"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1488f00baa934f2e9b910644a179c755"}]}] Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesSnapshotTestJSON-1737726883 Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 1488f00baa934f2e9b910644a179c755 Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1737726883 Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesSnapshotTestJSON-1737726883-project Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 8fe575351bdc456682db592f0c723ea6 Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesSnapshotTestJSON-1737726883-project Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance c3a00ef7-7e76-4e05-9c55-03698e3a7a9f could not be found. Sep 14 12:12:42.095232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'c3a00ef7-7e76-4e05-9c55-03698e3a7a9f'} Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3a00ef7-7e76-4e05-9c55-03698e3a7a9f could not be found. Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:12:42.095995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3a00ef7-7e76-4e05-9c55-03698e3a7a9f could not be found. Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3a00ef7-7e76-4e05-9c55-03698e3a7a9f could not be found. Sep 14 12:12:42.097245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:12:42.098496 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] Returning 404 to user: Instance c3a00ef7-7e76-4e05-9c55-03698e3a7a9f could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:12:42.098496 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ec0f3ff5-2d18-429f-95a5-b75fbc3d716b tempest-VolumesSnapshotTestJSON-1737726883 tempest-VolumesSnapshotTestJSON-1737726883-project] 10.222.0.62 "GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f" status: 404 len: 111 microversion: 2.1 time: 0.029728 Sep 14 12:12:42.098496 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 382/761] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:12:42 2022] GET /compute/v2.1/servers/c3a00ef7-7e76-4e05-9c55-03698e3a7a9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:12:51.516954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:51.517620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:51.659162 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-91e0bfdf-bcb8-4e1b-a816-b52fa1e41751 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "250ebf0b-7e63-4d27-81e2-335622d0de93"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:12:51.661759 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-91e0bfdf-bcb8-4e1b-a816-b52fa1e41751 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:12:51.667744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e0bfdf-bcb8-4e1b-a816-b52fa1e41751 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:51.668233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e0bfdf-bcb8-4e1b-a816-b52fa1e41751 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:51.668668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e0bfdf-bcb8-4e1b-a816-b52fa1e41751 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:51.669358 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e0bfdf-bcb8-4e1b-a816-b52fa1e41751 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:12:51.669837 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e0bfdf-bcb8-4e1b-a816-b52fa1e41751 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:12:51.670295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e0bfdf-bcb8-4e1b-a816-b52fa1e41751 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:12:52.487498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-91e0bfdf-bcb8-4e1b-a816-b52fa1e41751 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.975600 Sep 14 12:12:52.488121 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 380/762] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:12:51 2022] POST /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments => generated 194 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:13:02.844538 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b89a469d-3e07-46b5-bc09-4a5f695be8d0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:02.846020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b89a469d-3e07-46b5-bc09-4a5f695be8d0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:02.848280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=31 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:02.849332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=13 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:02.854552 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b89a469d-3e07-46b5-bc09-4a5f695be8d0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:02.855258 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b89a469d-3e07-46b5-bc09-4a5f695be8d0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:02.855915 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b89a469d-3e07-46b5-bc09-4a5f695be8d0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:02.856603 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b89a469d-3e07-46b5-bc09-4a5f695be8d0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:02.857055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b89a469d-3e07-46b5-bc09-4a5f695be8d0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:02.857477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b89a469d-3e07-46b5-bc09-4a5f695be8d0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:02.940361 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-b89a469d-3e07-46b5-bc09-4a5f695be8d0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lazy-loading 'services' on Instance uuid 76ce41d2-7079-429c-a18a-de51b2c20e6b {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:13:03.130146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b89a469d-3e07-46b5-bc09-4a5f695be8d0 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "DELETE /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/os-volume_attachments/73423d7f-9e8a-469a-9694-8bd0ba4884dc" status: 202 len: 0 microversion: 2.1 time: 0.290210 Sep 14 12:13:03.136691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 383/763] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:13:02 2022] DELETE /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/os-volume_attachments/73423d7f-9e8a-469a-9694-8bd0ba4884dc => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:13:03.412935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fc04b07f-5b76-4cd0-8f74-abcff8e12143 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:13:03.415820 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fc04b07f-5b76-4cd0-8f74-abcff8e12143 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:03.418653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:03.419336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:03.424723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc04b07f-5b76-4cd0-8f74-abcff8e12143 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:03.429934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc04b07f-5b76-4cd0-8f74-abcff8e12143 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:03.429934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc04b07f-5b76-4cd0-8f74-abcff8e12143 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:03.429934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc04b07f-5b76-4cd0-8f74-abcff8e12143 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:03.429934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc04b07f-5b76-4cd0-8f74-abcff8e12143 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:03.430375 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fc04b07f-5b76-4cd0-8f74-abcff8e12143 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:03.451131 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-fc04b07f-5b76-4cd0-8f74-abcff8e12143 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lazy-loading 'flavor' on Instance uuid bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:13:03.781809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fc04b07f-5b76-4cd0-8f74-abcff8e12143 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/action" status: 200 len: 32 microversion: 2.1 time: 0.373517 Sep 14 12:13:03.782363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 381/764] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:13:03 2022] POST /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/action => generated 32 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 12:13:03.792240 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5cb88b3c-4ebf-4772-99e0-235769533783 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:03.792970 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5cb88b3c-4ebf-4772-99e0-235769533783 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:03.799306 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5cb88b3c-4ebf-4772-99e0-235769533783 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:03.799790 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5cb88b3c-4ebf-4772-99e0-235769533783 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:03.800244 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5cb88b3c-4ebf-4772-99e0-235769533783 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:03.800943 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5cb88b3c-4ebf-4772-99e0-235769533783 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:03.801395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5cb88b3c-4ebf-4772-99e0-235769533783 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:03.801821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5cb88b3c-4ebf-4772-99e0-235769533783 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:03.939909 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5cb88b3c-4ebf-4772-99e0-235769533783 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:03.948927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5cb88b3c-4ebf-4772-99e0-235769533783 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.160814 Sep 14 12:13:03.949514 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 384/765] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:03 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:04.976194 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-394e6158-f5ab-4ed3-ad69-24569134d91c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:04.976988 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-394e6158-f5ab-4ed3-ad69-24569134d91c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:04.984848 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-394e6158-f5ab-4ed3-ad69-24569134d91c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:04.985978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-394e6158-f5ab-4ed3-ad69-24569134d91c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:04.986810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-394e6158-f5ab-4ed3-ad69-24569134d91c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:04.987879 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-394e6158-f5ab-4ed3-ad69-24569134d91c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:04.988451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-394e6158-f5ab-4ed3-ad69-24569134d91c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:04.988944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-394e6158-f5ab-4ed3-ad69-24569134d91c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:05.306752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-394e6158-f5ab-4ed3-ad69-24569134d91c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:05.316287 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-394e6158-f5ab-4ed3-ad69-24569134d91c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.345163 Sep 14 12:13:05.317189 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 382/766] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:04 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:05.363266 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8a798808-f818-4adb-84c9-1c957232fd9b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:13:05.369601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8a798808-f818-4adb-84c9-1c957232fd9b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:05.370118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8a798808-f818-4adb-84c9-1c957232fd9b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:05.370544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8a798808-f818-4adb-84c9-1c957232fd9b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:05.393893 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8a798808-f818-4adb-84c9-1c957232fd9b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Going to try to stop instance {{(pid=121152) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 12:13:05.618060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8a798808-f818-4adb-84c9-1c957232fd9b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/action" status: 202 len: 0 microversion: 2.1 time: 0.258283 Sep 14 12:13:05.618602 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 385/767] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:13:05 2022] POST /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:13:05.626969 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d607c4a2-348b-4d8f-9526-a91f2bf75efe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:05.627710 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d607c4a2-348b-4d8f-9526-a91f2bf75efe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:05.633709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d607c4a2-348b-4d8f-9526-a91f2bf75efe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:05.634229 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d607c4a2-348b-4d8f-9526-a91f2bf75efe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:05.634665 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d607c4a2-348b-4d8f-9526-a91f2bf75efe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:05.635448 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d607c4a2-348b-4d8f-9526-a91f2bf75efe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:05.635904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d607c4a2-348b-4d8f-9526-a91f2bf75efe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:05.636332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d607c4a2-348b-4d8f-9526-a91f2bf75efe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:05.774242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d607c4a2-348b-4d8f-9526-a91f2bf75efe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:05.782418 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d607c4a2-348b-4d8f-9526-a91f2bf75efe tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1678 microversion: 2.1 time: 0.159431 Sep 14 12:13:05.783187 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 383/768] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:05 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:06.340949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ac569c94-efe8-4181-a6d3-9d415e341d28 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:06.341677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ac569c94-efe8-4181-a6d3-9d415e341d28 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:06.348276 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac569c94-efe8-4181-a6d3-9d415e341d28 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:06.348764 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac569c94-efe8-4181-a6d3-9d415e341d28 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:06.349203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac569c94-efe8-4181-a6d3-9d415e341d28 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:06.349955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac569c94-efe8-4181-a6d3-9d415e341d28 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:06.350402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac569c94-efe8-4181-a6d3-9d415e341d28 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:06.350820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac569c94-efe8-4181-a6d3-9d415e341d28 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:06.486673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ac569c94-efe8-4181-a6d3-9d415e341d28 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:06.496364 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ac569c94-efe8-4181-a6d3-9d415e341d28 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.159704 Sep 14 12:13:06.496937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 386/769] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:06 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:06.805749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-27ac5794-5d81-469e-babd-59de88e1e138 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:06.806459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-27ac5794-5d81-469e-babd-59de88e1e138 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:06.812800 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ac5794-5d81-469e-babd-59de88e1e138 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:06.813286 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ac5794-5d81-469e-babd-59de88e1e138 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:06.813718 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ac5794-5d81-469e-babd-59de88e1e138 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:06.814435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ac5794-5d81-469e-babd-59de88e1e138 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:06.814887 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ac5794-5d81-469e-babd-59de88e1e138 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:06.815309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-27ac5794-5d81-469e-babd-59de88e1e138 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:06.955685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-27ac5794-5d81-469e-babd-59de88e1e138 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:06.963841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-27ac5794-5d81-469e-babd-59de88e1e138 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1678 microversion: 2.1 time: 0.162361 Sep 14 12:13:06.964459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 384/770] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:06 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:07.518560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4cd1990c-7dd5-4507-a475-375f5b435526 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:07.519161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4cd1990c-7dd5-4507-a475-375f5b435526 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:07.525735 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4cd1990c-7dd5-4507-a475-375f5b435526 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:07.526245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4cd1990c-7dd5-4507-a475-375f5b435526 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:07.526679 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4cd1990c-7dd5-4507-a475-375f5b435526 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:07.527358 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4cd1990c-7dd5-4507-a475-375f5b435526 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:07.527802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4cd1990c-7dd5-4507-a475-375f5b435526 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:07.528221 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4cd1990c-7dd5-4507-a475-375f5b435526 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:07.655613 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4cd1990c-7dd5-4507-a475-375f5b435526 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:07.664423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4cd1990c-7dd5-4507-a475-375f5b435526 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.149711 Sep 14 12:13:07.664990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 387/771] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:07 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:07.987253 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-97063449-4178-4d22-810b-b565af19ccf9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:07.987871 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-97063449-4178-4d22-810b-b565af19ccf9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:07.994273 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97063449-4178-4d22-810b-b565af19ccf9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:07.994763 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97063449-4178-4d22-810b-b565af19ccf9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:07.995203 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97063449-4178-4d22-810b-b565af19ccf9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:07.995905 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97063449-4178-4d22-810b-b565af19ccf9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:07.996360 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97063449-4178-4d22-810b-b565af19ccf9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:07.996786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97063449-4178-4d22-810b-b565af19ccf9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:08.128755 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-97063449-4178-4d22-810b-b565af19ccf9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:08.137273 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-97063449-4178-4d22-810b-b565af19ccf9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1678 microversion: 2.1 time: 0.153939 Sep 14 12:13:08.137955 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 385/772] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:07 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:08.687130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2d0bfed6-57d1-459e-bff2-84ffaa3fd34c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:08.687801 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2d0bfed6-57d1-459e-bff2-84ffaa3fd34c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:08.694855 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d0bfed6-57d1-459e-bff2-84ffaa3fd34c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:08.695384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d0bfed6-57d1-459e-bff2-84ffaa3fd34c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:08.695838 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d0bfed6-57d1-459e-bff2-84ffaa3fd34c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:08.696523 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d0bfed6-57d1-459e-bff2-84ffaa3fd34c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:08.696974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d0bfed6-57d1-459e-bff2-84ffaa3fd34c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:08.697395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d0bfed6-57d1-459e-bff2-84ffaa3fd34c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:08.830191 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d0bfed6-57d1-459e-bff2-84ffaa3fd34c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:08.840214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2d0bfed6-57d1-459e-bff2-84ffaa3fd34c tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.156985 Sep 14 12:13:08.840793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 388/773] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:08 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:09.162203 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f0691a59-96f8-47d0-b9dd-b87b88024768 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:09.162817 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f0691a59-96f8-47d0-b9dd-b87b88024768 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:09.168723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0691a59-96f8-47d0-b9dd-b87b88024768 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:09.169215 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0691a59-96f8-47d0-b9dd-b87b88024768 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:09.169661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0691a59-96f8-47d0-b9dd-b87b88024768 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:09.170390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0691a59-96f8-47d0-b9dd-b87b88024768 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:09.170850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0691a59-96f8-47d0-b9dd-b87b88024768 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:09.171282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0691a59-96f8-47d0-b9dd-b87b88024768 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:09.306367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0691a59-96f8-47d0-b9dd-b87b88024768 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:09.316434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f0691a59-96f8-47d0-b9dd-b87b88024768 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1678 microversion: 2.1 time: 0.157456 Sep 14 12:13:09.323408 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 386/774] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:09 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:09.862658 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-45404c6a-e826-4821-b4ab-57a2e97e1ee4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:09.863259 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-45404c6a-e826-4821-b4ab-57a2e97e1ee4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:09.870439 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45404c6a-e826-4821-b4ab-57a2e97e1ee4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:09.870918 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45404c6a-e826-4821-b4ab-57a2e97e1ee4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:09.871347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45404c6a-e826-4821-b4ab-57a2e97e1ee4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:09.872020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45404c6a-e826-4821-b4ab-57a2e97e1ee4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:09.872468 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45404c6a-e826-4821-b4ab-57a2e97e1ee4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:09.872882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-45404c6a-e826-4821-b4ab-57a2e97e1ee4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:10.008468 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-45404c6a-e826-4821-b4ab-57a2e97e1ee4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:10.018268 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-45404c6a-e826-4821-b4ab-57a2e97e1ee4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.159371 Sep 14 12:13:10.018849 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 389/775] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:09 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:10.340721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c2e5b8bd-459e-4dd1-909b-c7a13d08658b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:10.341352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c2e5b8bd-459e-4dd1-909b-c7a13d08658b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:10.348089 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b8bd-459e-4dd1-909b-c7a13d08658b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:10.348571 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b8bd-459e-4dd1-909b-c7a13d08658b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:10.349037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b8bd-459e-4dd1-909b-c7a13d08658b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:10.349735 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b8bd-459e-4dd1-909b-c7a13d08658b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:10.350223 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b8bd-459e-4dd1-909b-c7a13d08658b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:10.350653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b8bd-459e-4dd1-909b-c7a13d08658b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:10.484884 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c2e5b8bd-459e-4dd1-909b-c7a13d08658b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:10.496686 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c2e5b8bd-459e-4dd1-909b-c7a13d08658b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1678 microversion: 2.1 time: 0.159483 Sep 14 12:13:10.497658 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 387/776] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:10 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:13:11.050263 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2212b7e5-3eaa-499a-a15e-ce180d5c6944 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:11.051024 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2212b7e5-3eaa-499a-a15e-ce180d5c6944 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:11.057690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2212b7e5-3eaa-499a-a15e-ce180d5c6944 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:11.058204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2212b7e5-3eaa-499a-a15e-ce180d5c6944 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:11.058650 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2212b7e5-3eaa-499a-a15e-ce180d5c6944 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:11.059335 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2212b7e5-3eaa-499a-a15e-ce180d5c6944 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:11.059783 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2212b7e5-3eaa-499a-a15e-ce180d5c6944 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:11.060205 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2212b7e5-3eaa-499a-a15e-ce180d5c6944 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:11.196514 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2212b7e5-3eaa-499a-a15e-ce180d5c6944 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:11.205371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2212b7e5-3eaa-499a-a15e-ce180d5c6944 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.159276 Sep 14 12:13:11.205962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 390/777] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:11 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:11.521132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2ee759bb-6492-44e3-9a9c-d300e444e8d9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:11.522242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ee759bb-6492-44e3-9a9c-d300e444e8d9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:11.528392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ee759bb-6492-44e3-9a9c-d300e444e8d9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:11.528879 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ee759bb-6492-44e3-9a9c-d300e444e8d9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:11.529322 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ee759bb-6492-44e3-9a9c-d300e444e8d9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:11.530055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ee759bb-6492-44e3-9a9c-d300e444e8d9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:11.530516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ee759bb-6492-44e3-9a9c-d300e444e8d9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:11.530948 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ee759bb-6492-44e3-9a9c-d300e444e8d9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:11.666522 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2ee759bb-6492-44e3-9a9c-d300e444e8d9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:11.674340 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2ee759bb-6492-44e3-9a9c-d300e444e8d9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1678 microversion: 2.1 time: 0.157098 Sep 14 12:13:11.674928 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 388/778] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:11 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:13:12.229603 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e8048f4d-d998-4604-b241-d6032d66c06a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:12.230255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e8048f4d-d998-4604-b241-d6032d66c06a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:12.237551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8048f4d-d998-4604-b241-d6032d66c06a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:12.238155 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8048f4d-d998-4604-b241-d6032d66c06a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:12.238631 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8048f4d-d998-4604-b241-d6032d66c06a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:12.239647 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8048f4d-d998-4604-b241-d6032d66c06a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:12.240178 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8048f4d-d998-4604-b241-d6032d66c06a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:12.240645 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8048f4d-d998-4604-b241-d6032d66c06a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:12.375672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e8048f4d-d998-4604-b241-d6032d66c06a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:12.384425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e8048f4d-d998-4604-b241-d6032d66c06a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.158948 Sep 14 12:13:12.384990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 391/779] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:12 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:13:12.697488 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-aecd5cf9-822c-4c7e-8088-360835baf076 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:12.704256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-aecd5cf9-822c-4c7e-8088-360835baf076 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:12.704650 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aecd5cf9-822c-4c7e-8088-360835baf076 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:12.705164 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aecd5cf9-822c-4c7e-8088-360835baf076 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:12.705607 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aecd5cf9-822c-4c7e-8088-360835baf076 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:12.706352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aecd5cf9-822c-4c7e-8088-360835baf076 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:12.706812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aecd5cf9-822c-4c7e-8088-360835baf076 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:12.707252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-aecd5cf9-822c-4c7e-8088-360835baf076 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:12.846309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-aecd5cf9-822c-4c7e-8088-360835baf076 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:12.855086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-aecd5cf9-822c-4c7e-8088-360835baf076 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1678 microversion: 2.1 time: 0.161510 Sep 14 12:13:12.855701 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 389/780] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:12 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:13.408824 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e2db836c-9aca-4bd8-b0c8-b108ae724e3b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:13.409579 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e2db836c-9aca-4bd8-b0c8-b108ae724e3b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:13.417503 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2db836c-9aca-4bd8-b0c8-b108ae724e3b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:13.418209 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2db836c-9aca-4bd8-b0c8-b108ae724e3b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:13.418493 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2db836c-9aca-4bd8-b0c8-b108ae724e3b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:13.419203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2db836c-9aca-4bd8-b0c8-b108ae724e3b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:13.419662 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2db836c-9aca-4bd8-b0c8-b108ae724e3b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:13.420093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2db836c-9aca-4bd8-b0c8-b108ae724e3b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:13.571477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e2db836c-9aca-4bd8-b0c8-b108ae724e3b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:13.579789 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e2db836c-9aca-4bd8-b0c8-b108ae724e3b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.175276 Sep 14 12:13:13.580360 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 392/781] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:13 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:13.879526 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cd79a3ab-d6f6-4d3c-a19f-fb45dfaf9a30 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:13.880779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cd79a3ab-d6f6-4d3c-a19f-fb45dfaf9a30 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:13.887212 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd79a3ab-d6f6-4d3c-a19f-fb45dfaf9a30 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:13.896722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd79a3ab-d6f6-4d3c-a19f-fb45dfaf9a30 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:13.896722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd79a3ab-d6f6-4d3c-a19f-fb45dfaf9a30 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:13.896722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd79a3ab-d6f6-4d3c-a19f-fb45dfaf9a30 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:13.896722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd79a3ab-d6f6-4d3c-a19f-fb45dfaf9a30 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:13.897131 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cd79a3ab-d6f6-4d3c-a19f-fb45dfaf9a30 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:14.027831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cd79a3ab-d6f6-4d3c-a19f-fb45dfaf9a30 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:14.038029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cd79a3ab-d6f6-4d3c-a19f-fb45dfaf9a30 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1678 microversion: 2.1 time: 0.162370 Sep 14 12:13:14.038671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 390/782] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:13 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:14.604559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-50daf214-6300-42ad-8221-97a79f614d89 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:14.605452 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-50daf214-6300-42ad-8221-97a79f614d89 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:14.611847 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50daf214-6300-42ad-8221-97a79f614d89 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:14.612336 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50daf214-6300-42ad-8221-97a79f614d89 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:14.612771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50daf214-6300-42ad-8221-97a79f614d89 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:14.613458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50daf214-6300-42ad-8221-97a79f614d89 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:14.613942 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50daf214-6300-42ad-8221-97a79f614d89 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:14.614858 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50daf214-6300-42ad-8221-97a79f614d89 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:14.778976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-50daf214-6300-42ad-8221-97a79f614d89 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:14.787913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-50daf214-6300-42ad-8221-97a79f614d89 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.187224 Sep 14 12:13:14.788487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 393/783] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:14 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:13:15.062225 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-956e836f-36a5-4c84-86e9-fd337c466ea2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:15.062838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-956e836f-36a5-4c84-86e9-fd337c466ea2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:15.071888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-956e836f-36a5-4c84-86e9-fd337c466ea2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:15.072457 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-956e836f-36a5-4c84-86e9-fd337c466ea2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:15.072897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-956e836f-36a5-4c84-86e9-fd337c466ea2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:15.073607 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-956e836f-36a5-4c84-86e9-fd337c466ea2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:15.074092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-956e836f-36a5-4c84-86e9-fd337c466ea2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:15.074512 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-956e836f-36a5-4c84-86e9-fd337c466ea2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:15.271562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-956e836f-36a5-4c84-86e9-fd337c466ea2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:15.279896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-956e836f-36a5-4c84-86e9-fd337c466ea2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1678 microversion: 2.1 time: 0.222100 Sep 14 12:13:15.280483 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 391/784] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:15 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:13:15.811313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ee9e47ec-6642-4bbc-af06-a6dfa2361276 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:15.811950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ee9e47ec-6642-4bbc-af06-a6dfa2361276 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:15.819164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee9e47ec-6642-4bbc-af06-a6dfa2361276 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:15.819646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee9e47ec-6642-4bbc-af06-a6dfa2361276 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:15.820079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee9e47ec-6642-4bbc-af06-a6dfa2361276 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:15.820767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee9e47ec-6642-4bbc-af06-a6dfa2361276 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:15.821214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee9e47ec-6642-4bbc-af06-a6dfa2361276 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:15.821629 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee9e47ec-6642-4bbc-af06-a6dfa2361276 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:16.225239 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ee9e47ec-6642-4bbc-af06-a6dfa2361276 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:16.234254 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ee9e47ec-6642-4bbc-af06-a6dfa2361276 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.426940 Sep 14 12:13:16.234873 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 394/785] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:15 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:16.304860 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-18ab163e-7818-4573-ac17-221261e16c02 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:16.305599 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-18ab163e-7818-4573-ac17-221261e16c02 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:16.312043 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab163e-7818-4573-ac17-221261e16c02 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:16.312535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab163e-7818-4573-ac17-221261e16c02 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:16.312974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab163e-7818-4573-ac17-221261e16c02 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:16.313684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab163e-7818-4573-ac17-221261e16c02 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:16.314239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab163e-7818-4573-ac17-221261e16c02 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:16.314673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-18ab163e-7818-4573-ac17-221261e16c02 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:16.481510 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-18ab163e-7818-4573-ac17-221261e16c02 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:16.493551 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-18ab163e-7818-4573-ac17-221261e16c02 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1678 microversion: 2.1 time: 0.192333 Sep 14 12:13:16.494629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 392/786] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:16 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:17.258732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-06f8c401-d788-4bfb-90f6-e9f02e3ab4f0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:17.259363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-06f8c401-d788-4bfb-90f6-e9f02e3ab4f0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:17.265827 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06f8c401-d788-4bfb-90f6-e9f02e3ab4f0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:17.266335 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06f8c401-d788-4bfb-90f6-e9f02e3ab4f0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:17.266763 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06f8c401-d788-4bfb-90f6-e9f02e3ab4f0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:17.267486 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06f8c401-d788-4bfb-90f6-e9f02e3ab4f0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:17.267978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06f8c401-d788-4bfb-90f6-e9f02e3ab4f0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:17.268387 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06f8c401-d788-4bfb-90f6-e9f02e3ab4f0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:17.428955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-06f8c401-d788-4bfb-90f6-e9f02e3ab4f0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:17.437410 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-06f8c401-d788-4bfb-90f6-e9f02e3ab4f0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.183212 Sep 14 12:13:17.438018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 395/787] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:17 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:17.519004 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-706c5c45-e16e-464d-b2cf-440a371bcd07 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:17.519577 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-706c5c45-e16e-464d-b2cf-440a371bcd07 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:17.527187 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-706c5c45-e16e-464d-b2cf-440a371bcd07 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:17.528042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-706c5c45-e16e-464d-b2cf-440a371bcd07 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:17.528793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-706c5c45-e16e-464d-b2cf-440a371bcd07 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:17.529538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-706c5c45-e16e-464d-b2cf-440a371bcd07 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:17.530043 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-706c5c45-e16e-464d-b2cf-440a371bcd07 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:17.530475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-706c5c45-e16e-464d-b2cf-440a371bcd07 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:17.673668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-706c5c45-e16e-464d-b2cf-440a371bcd07 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:17.683893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-706c5c45-e16e-464d-b2cf-440a371bcd07 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1655 microversion: 2.1 time: 0.168940 Sep 14 12:13:17.684487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 393/788] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:17 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:13:17.707208 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-24b7d84b-4429-4b2e-bf57-28181f01524e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:13:17.721953 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-24b7d84b-4429-4b2e-bf57-28181f01524e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:17.721953 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-24b7d84b-4429-4b2e-bf57-28181f01524e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:17.721953 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-24b7d84b-4429-4b2e-bf57-28181f01524e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:17.740691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-24b7d84b-4429-4b2e-bf57-28181f01524e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Going to try to start instance {{(pid=121152) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 12:13:17.832762 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:17.944582 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-24b7d84b-4429-4b2e-bf57-28181f01524e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/action" status: 202 len: 0 microversion: 2.1 time: 0.241156 Sep 14 12:13:17.945213 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 396/789] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:13:17 2022] POST /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:13:17.953812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-379b5160-9e6c-4c13-b976-966a3c68312d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:17.954827 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-379b5160-9e6c-4c13-b976-966a3c68312d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:17.962217 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-379b5160-9e6c-4c13-b976-966a3c68312d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:17.963002 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-379b5160-9e6c-4c13-b976-966a3c68312d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:17.963599 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-379b5160-9e6c-4c13-b976-966a3c68312d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:17.964667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-379b5160-9e6c-4c13-b976-966a3c68312d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:17.965438 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-379b5160-9e6c-4c13-b976-966a3c68312d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:17.965983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-379b5160-9e6c-4c13-b976-966a3c68312d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:18.152030 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-379b5160-9e6c-4c13-b976-966a3c68312d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:18.160159 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-379b5160-9e6c-4c13-b976-966a3c68312d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1664 microversion: 2.1 time: 0.210456 Sep 14 12:13:18.160751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 394/790] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:17 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1664 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:18.467349 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5dc18630-9bdf-45fa-9d5e-5bb060ff326b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:18.471090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5dc18630-9bdf-45fa-9d5e-5bb060ff326b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:18.479935 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dc18630-9bdf-45fa-9d5e-5bb060ff326b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:18.480744 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dc18630-9bdf-45fa-9d5e-5bb060ff326b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:18.481432 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dc18630-9bdf-45fa-9d5e-5bb060ff326b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:18.482499 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dc18630-9bdf-45fa-9d5e-5bb060ff326b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:18.488048 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dc18630-9bdf-45fa-9d5e-5bb060ff326b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:18.488048 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dc18630-9bdf-45fa-9d5e-5bb060ff326b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:18.644238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5dc18630-9bdf-45fa-9d5e-5bb060ff326b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:18.655314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5dc18630-9bdf-45fa-9d5e-5bb060ff326b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.197608 Sep 14 12:13:18.656100 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 397/791] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:18 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:13:19.190928 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-20f9baea-378f-48cb-ab60-ec9f7ba490db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:19.191846 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-20f9baea-378f-48cb-ab60-ec9f7ba490db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:19.198359 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20f9baea-378f-48cb-ab60-ec9f7ba490db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:19.198850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20f9baea-378f-48cb-ab60-ec9f7ba490db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:19.199289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20f9baea-378f-48cb-ab60-ec9f7ba490db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:19.200025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20f9baea-378f-48cb-ab60-ec9f7ba490db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:19.200482 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20f9baea-378f-48cb-ab60-ec9f7ba490db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:19.200907 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-20f9baea-378f-48cb-ab60-ec9f7ba490db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:19.219703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:19.427332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-20f9baea-378f-48cb-ab60-ec9f7ba490db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:19.434826 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-20f9baea-378f-48cb-ab60-ec9f7ba490db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1664 microversion: 2.1 time: 0.254630 Sep 14 12:13:19.435398 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 395/792] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:19 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1664 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:19.679249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4eed30d5-7e30-4ab8-9f05-792bbb4e23ba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:19.679859 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4eed30d5-7e30-4ab8-9f05-792bbb4e23ba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:19.686806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eed30d5-7e30-4ab8-9f05-792bbb4e23ba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:19.687299 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eed30d5-7e30-4ab8-9f05-792bbb4e23ba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:19.687739 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eed30d5-7e30-4ab8-9f05-792bbb4e23ba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:19.688430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eed30d5-7e30-4ab8-9f05-792bbb4e23ba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:19.688887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eed30d5-7e30-4ab8-9f05-792bbb4e23ba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:19.689314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4eed30d5-7e30-4ab8-9f05-792bbb4e23ba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:19.839404 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4eed30d5-7e30-4ab8-9f05-792bbb4e23ba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:19.849269 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4eed30d5-7e30-4ab8-9f05-792bbb4e23ba tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1733 microversion: 2.1 time: 0.173007 Sep 14 12:13:19.851642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 398/793] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:19 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:20.460214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e5e97039-5094-4fbf-8aaa-457909071cff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:20.461001 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e5e97039-5094-4fbf-8aaa-457909071cff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:20.471594 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5e97039-5094-4fbf-8aaa-457909071cff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:20.472082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5e97039-5094-4fbf-8aaa-457909071cff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:20.472522 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5e97039-5094-4fbf-8aaa-457909071cff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:20.473210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5e97039-5094-4fbf-8aaa-457909071cff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:20.473685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5e97039-5094-4fbf-8aaa-457909071cff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:20.474140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e5e97039-5094-4fbf-8aaa-457909071cff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:20.628608 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e5e97039-5094-4fbf-8aaa-457909071cff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:20.635719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e5e97039-5094-4fbf-8aaa-457909071cff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1664 microversion: 2.1 time: 0.179694 Sep 14 12:13:20.636308 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 396/794] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:20 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:20.871757 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-892faa36-1129-42b2-848c-9600d2d2ba7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:20.872366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-892faa36-1129-42b2-848c-9600d2d2ba7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:20.878944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-892faa36-1129-42b2-848c-9600d2d2ba7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:20.879429 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-892faa36-1129-42b2-848c-9600d2d2ba7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:20.879869 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-892faa36-1129-42b2-848c-9600d2d2ba7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:20.880576 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-892faa36-1129-42b2-848c-9600d2d2ba7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:20.881030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-892faa36-1129-42b2-848c-9600d2d2ba7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:20.881478 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-892faa36-1129-42b2-848c-9600d2d2ba7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:21.015804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-892faa36-1129-42b2-848c-9600d2d2ba7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:21.026754 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-892faa36-1129-42b2-848c-9600d2d2ba7a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1713 microversion: 2.1 time: 0.158757 Sep 14 12:13:21.027457 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 399/795] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:20 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1713 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:21.173363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:21.173853 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:21.180623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:21.181402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:21.181960 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:21.182738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:21.183232 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:21.183812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:21.323465 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] HTTP exception thrown: Cannot 'detach_volume' instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 while it is in vm_state rescued Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Request method failure captured: Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: DELETE /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments/250ebf0b-7e63-4d27-81e2-335622d0de93 HTTP/1.1 Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcO0QaCS6xXTzM6jpZKpig5OWwgN4DxcmFTi61vISCiYbIqj92GCFK2Ykao8lOPtpzCjwB5UFh2EALT9e-6aRP6sfCRAMRClNQTuYs6OK-1skVV-bbMgM1Rb_IgbUayTgQvhQjd_qmnAYRMCxoLQ6qRy3J7d-3d9WDsecW3_-xRcxwM Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 748b7c08460b4f718dfff67275d8e4e4 Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:13:21.325091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/748b7c08460b4f718dfff67275d8e4e4"}]}] Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 748b7c08460b4f718dfff67275d8e4e4 Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-ServerRescueNegativeTestJSON-761218752-project Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 4bd4125ff6bb400bae1b94df7d2cfa17 Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-ServerRescueNegativeTestJSON-761218752-project Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:13:21.326685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Cannot 'detach_volume' instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 while it is in vm_state rescued Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'server_id': 'bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1', 'id': '250ebf0b-7e63-4d27-81e2-335622d0de93'} Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:13:21.327587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 while it is in vm_state rescued Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 while it is in vm_state rescued Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:13:21.329403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Returning 409 to user: Cannot 'detach_volume' instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 while it is in vm_state rescued {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:13:21.330876 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f6e930f4-4765-4847-84a0-d7781e28447a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments/250ebf0b-7e63-4d27-81e2-335622d0de93" status: 409 len: 152 microversion: 2.1 time: 0.157172 Sep 14 12:13:21.330876 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 397/796] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:13:21 2022] DELETE /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments/250ebf0b-7e63-4d27-81e2-335622d0de93 => generated 152 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 14 12:13:21.337774 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-13c6d45e-9e7e-45aa-bdeb-1d55df2fac11 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:13:21.338341 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-13c6d45e-9e7e-45aa-bdeb-1d55df2fac11 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:21.344707 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13c6d45e-9e7e-45aa-bdeb-1d55df2fac11 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:21.345541 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13c6d45e-9e7e-45aa-bdeb-1d55df2fac11 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:21.345682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13c6d45e-9e7e-45aa-bdeb-1d55df2fac11 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:21.346617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13c6d45e-9e7e-45aa-bdeb-1d55df2fac11 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:21.347080 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13c6d45e-9e7e-45aa-bdeb-1d55df2fac11 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:21.347510 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-13c6d45e-9e7e-45aa-bdeb-1d55df2fac11 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:21.596098 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-13c6d45e-9e7e-45aa-bdeb-1d55df2fac11 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "POST /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/action" status: 202 len: 0 microversion: 2.1 time: 0.263927 Sep 14 12:13:21.602320 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 400/797] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:13:21 2022] POST /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 12:13:21.605628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c52962ca-f8c1-4346-ae95-d50edddca3fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:21.606273 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c52962ca-f8c1-4346-ae95-d50edddca3fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:21.613545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c52962ca-f8c1-4346-ae95-d50edddca3fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:21.614096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c52962ca-f8c1-4346-ae95-d50edddca3fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:21.615143 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c52962ca-f8c1-4346-ae95-d50edddca3fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:21.615850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c52962ca-f8c1-4346-ae95-d50edddca3fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:21.616310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c52962ca-f8c1-4346-ae95-d50edddca3fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:21.616743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c52962ca-f8c1-4346-ae95-d50edddca3fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:21.662409 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d381223c-d846-4789-a80e-9ee713632fa8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:21.663122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d381223c-d846-4789-a80e-9ee713632fa8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:21.669642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d381223c-d846-4789-a80e-9ee713632fa8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:21.670151 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d381223c-d846-4789-a80e-9ee713632fa8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:21.670581 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d381223c-d846-4789-a80e-9ee713632fa8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:21.671277 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d381223c-d846-4789-a80e-9ee713632fa8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:21.671728 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d381223c-d846-4789-a80e-9ee713632fa8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:21.672317 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d381223c-d846-4789-a80e-9ee713632fa8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:21.861466 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c52962ca-f8c1-4346-ae95-d50edddca3fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:21.871019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c52962ca-f8c1-4346-ae95-d50edddca3fc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1721 microversion: 2.1 time: 0.269191 Sep 14 12:13:21.871848 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 398/798] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:21 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:21.944535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d381223c-d846-4789-a80e-9ee713632fa8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:21.952777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d381223c-d846-4789-a80e-9ee713632fa8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1668 microversion: 2.1 time: 0.295058 Sep 14 12:13:21.953690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 401/799] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:21 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1668 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:22.903009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f3e32202-9486-4a82-88d2-cb859a54e2e5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:22.903623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f3e32202-9486-4a82-88d2-cb859a54e2e5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:22.910298 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3e32202-9486-4a82-88d2-cb859a54e2e5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:22.910787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3e32202-9486-4a82-88d2-cb859a54e2e5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:22.911220 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3e32202-9486-4a82-88d2-cb859a54e2e5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:22.911921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3e32202-9486-4a82-88d2-cb859a54e2e5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:22.912378 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3e32202-9486-4a82-88d2-cb859a54e2e5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:22.912800 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f3e32202-9486-4a82-88d2-cb859a54e2e5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:23.049575 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f3e32202-9486-4a82-88d2-cb859a54e2e5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:23.057907 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f3e32202-9486-4a82-88d2-cb859a54e2e5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1721 microversion: 2.1 time: 0.159120 Sep 14 12:13:23.058487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 399/800] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:22 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:24.080901 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e9a168e1-f477-46ea-9162-1d52f9e5f53b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:24.081464 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e9a168e1-f477-46ea-9162-1d52f9e5f53b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:24.089842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9a168e1-f477-46ea-9162-1d52f9e5f53b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:24.090508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9a168e1-f477-46ea-9162-1d52f9e5f53b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:24.090955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9a168e1-f477-46ea-9162-1d52f9e5f53b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:24.091664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9a168e1-f477-46ea-9162-1d52f9e5f53b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:24.092123 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9a168e1-f477-46ea-9162-1d52f9e5f53b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:24.092544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9a168e1-f477-46ea-9162-1d52f9e5f53b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:24.235355 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e9a168e1-f477-46ea-9162-1d52f9e5f53b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:24.244753 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e9a168e1-f477-46ea-9162-1d52f9e5f53b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1721 microversion: 2.1 time: 0.167801 Sep 14 12:13:24.245341 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 402/801] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:24 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:25.268194 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f0fb80b0-cac3-4870-8e4c-3737710b1bde tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:25.268865 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f0fb80b0-cac3-4870-8e4c-3737710b1bde tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:25.283412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0fb80b0-cac3-4870-8e4c-3737710b1bde tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:25.283965 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0fb80b0-cac3-4870-8e4c-3737710b1bde tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:25.284320 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0fb80b0-cac3-4870-8e4c-3737710b1bde tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:25.285472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0fb80b0-cac3-4870-8e4c-3737710b1bde tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:25.285472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0fb80b0-cac3-4870-8e4c-3737710b1bde tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:25.285909 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0fb80b0-cac3-4870-8e4c-3737710b1bde tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:25.443173 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0fb80b0-cac3-4870-8e4c-3737710b1bde tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:25.452387 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f0fb80b0-cac3-4870-8e4c-3737710b1bde tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1721 microversion: 2.1 time: 0.188157 Sep 14 12:13:25.452978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 400/802] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:25 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:26.477358 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6dfd9600-424f-44a3-b381-941890df8fe4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:26.477997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6dfd9600-424f-44a3-b381-941890df8fe4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:26.484688 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dfd9600-424f-44a3-b381-941890df8fe4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:26.485171 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dfd9600-424f-44a3-b381-941890df8fe4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:26.485610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dfd9600-424f-44a3-b381-941890df8fe4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:26.486418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dfd9600-424f-44a3-b381-941890df8fe4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:26.486875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dfd9600-424f-44a3-b381-941890df8fe4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:26.487303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dfd9600-424f-44a3-b381-941890df8fe4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:26.621276 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6dfd9600-424f-44a3-b381-941890df8fe4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:26.629638 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6dfd9600-424f-44a3-b381-941890df8fe4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1727 microversion: 2.1 time: 0.156780 Sep 14 12:13:26.630248 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 403/803] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:13:26 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:26.652991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2ce43fb1-de04-495d-b9ae-a327f5db856a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:26.653581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ce43fb1-de04-495d-b9ae-a327f5db856a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:26.660153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ce43fb1-de04-495d-b9ae-a327f5db856a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:26.660641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ce43fb1-de04-495d-b9ae-a327f5db856a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:26.661764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ce43fb1-de04-495d-b9ae-a327f5db856a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:26.662650 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ce43fb1-de04-495d-b9ae-a327f5db856a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:26.663059 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ce43fb1-de04-495d-b9ae-a327f5db856a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:26.663511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ce43fb1-de04-495d-b9ae-a327f5db856a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:26.744922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2ce43fb1-de04-495d-b9ae-a327f5db856a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096126 Sep 14 12:13:26.745511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 401/804] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 14 12:13:26 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:13:27.731657 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-3549ec86-272c-437b-bb8f-66cd127985fa req-75ea77d0-48a1-483d-b007-9468cde31d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1", "tag": "027c61fc-efa6-4219-96b2-fd9ae33eb05c"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:13:27.743249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-3549ec86-272c-437b-bb8f-66cd127985fa req-75ea77d0-48a1-483d-b007-9468cde31d8f service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:27.743741 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-3549ec86-272c-437b-bb8f-66cd127985fa req-75ea77d0-48a1-483d-b007-9468cde31d8f service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:27.744418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-3549ec86-272c-437b-bb8f-66cd127985fa req-75ea77d0-48a1-483d-b007-9468cde31d8f service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:27.767197 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-3549ec86-272c-437b-bb8f-66cd127985fa req-75ea77d0-48a1-483d-b007-9468cde31d8f service nova] Creating event network-changed:027c61fc-efa6-4219-96b2-fd9ae33eb05c for instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 on hv-cinder-84496 Sep 14 12:13:27.772477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-3549ec86-272c-437b-bb8f-66cd127985fa req-75ea77d0-48a1-483d-b007-9468cde31d8f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045133 Sep 14 12:13:27.773112 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 404/805] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:13:29.789368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-6658387c-fc6b-4682-8966-066e27bf5958 req-a67ff4c2-9b98-4015-9b6f-fa2b3d50b421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1", "tag": "027c61fc-efa6-4219-96b2-fd9ae33eb05c"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:13:29.803877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6658387c-fc6b-4682-8966-066e27bf5958 req-a67ff4c2-9b98-4015-9b6f-fa2b3d50b421 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:29.805029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6658387c-fc6b-4682-8966-066e27bf5958 req-a67ff4c2-9b98-4015-9b6f-fa2b3d50b421 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:29.805823 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6658387c-fc6b-4682-8966-066e27bf5958 req-a67ff4c2-9b98-4015-9b6f-fa2b3d50b421 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:29.830274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-6658387c-fc6b-4682-8966-066e27bf5958 req-a67ff4c2-9b98-4015-9b6f-fa2b3d50b421 service nova] Creating event network-changed:027c61fc-efa6-4219-96b2-fd9ae33eb05c for instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 on hv-cinder-84496 Sep 14 12:13:29.834587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-6658387c-fc6b-4682-8966-066e27bf5958 req-a67ff4c2-9b98-4015-9b6f-fa2b3d50b421 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050900 Sep 14 12:13:29.835259 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 402/806] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:13:42.458578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=44 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:42.459273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:42.463688 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-75ae8d91-3d3f-46e7-9fce-efaa432ddf36 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:42.464278 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-75ae8d91-3d3f-46e7-9fce-efaa432ddf36 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:42.470530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ae8d91-3d3f-46e7-9fce-efaa432ddf36 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:42.471431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ae8d91-3d3f-46e7-9fce-efaa432ddf36 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:42.471431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ae8d91-3d3f-46e7-9fce-efaa432ddf36 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:42.472180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ae8d91-3d3f-46e7-9fce-efaa432ddf36 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:42.472637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ae8d91-3d3f-46e7-9fce-efaa432ddf36 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:42.473084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ae8d91-3d3f-46e7-9fce-efaa432ddf36 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:42.503299 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-75ae8d91-3d3f-46e7-9fce-efaa432ddf36 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments/24a79ffa-b8a2-4bb0-95fd-892ab6ce766c" status: 200 len: 194 microversion: 2.20 time: 0.046387 Sep 14 12:13:42.503889 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 405/807] 10.222.0.62 () {60 vars in 1454 bytes} [Wed Sep 14 12:13:42 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments/24a79ffa-b8a2-4bb0-95fd-892ab6ce766c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:13:42.573941 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-da16e3f9-89fc-4024-a3f4-fd40b740c2da tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:42.574589 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-da16e3f9-89fc-4024-a3f4-fd40b740c2da tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:42.577128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=44 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:42.577906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=38 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:42.582694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da16e3f9-89fc-4024-a3f4-fd40b740c2da tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:42.583173 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da16e3f9-89fc-4024-a3f4-fd40b740c2da tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:42.583608 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da16e3f9-89fc-4024-a3f4-fd40b740c2da tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:42.584323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da16e3f9-89fc-4024-a3f4-fd40b740c2da tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:42.584768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da16e3f9-89fc-4024-a3f4-fd40b740c2da tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:42.585730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da16e3f9-89fc-4024-a3f4-fd40b740c2da tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:42.670857 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-da16e3f9-89fc-4024-a3f4-fd40b740c2da tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lazy-loading 'services' on Instance uuid b7b1312a-8b45-4481-9a44-f330379d0c8f {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:13:42.977643 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-da16e3f9-89fc-4024-a3f4-fd40b740c2da tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments/24a79ffa-b8a2-4bb0-95fd-892ab6ce766c" status: 202 len: 0 microversion: 2.20 time: 0.407898 Sep 14 12:13:42.978275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 403/808] 10.222.0.62 () {60 vars in 1457 bytes} [Wed Sep 14 12:13:42 2022] DELETE /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments/24a79ffa-b8a2-4bb0-95fd-892ab6ce766c => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:13:42.988069 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3aa74f74-a249-4c76-82cf-a2ac5bcfd5c0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:42.990257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3aa74f74-a249-4c76-82cf-a2ac5bcfd5c0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:42.998172 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3aa74f74-a249-4c76-82cf-a2ac5bcfd5c0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:42.998664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3aa74f74-a249-4c76-82cf-a2ac5bcfd5c0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:42.999105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3aa74f74-a249-4c76-82cf-a2ac5bcfd5c0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:42.999803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3aa74f74-a249-4c76-82cf-a2ac5bcfd5c0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:43.000281 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3aa74f74-a249-4c76-82cf-a2ac5bcfd5c0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:43.000708 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3aa74f74-a249-4c76-82cf-a2ac5bcfd5c0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:43.031674 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3aa74f74-a249-4c76-82cf-a2ac5bcfd5c0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048897 Sep 14 12:13:43.032261 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 406/809] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Sep 14 12:13:42 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:13:44.046009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d56ce714-f88c-4fd9-8637-bb1ba7279ad9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:44.052668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d56ce714-f88c-4fd9-8637-bb1ba7279ad9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:44.055915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d56ce714-f88c-4fd9-8637-bb1ba7279ad9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:44.056418 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d56ce714-f88c-4fd9-8637-bb1ba7279ad9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:44.056856 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d56ce714-f88c-4fd9-8637-bb1ba7279ad9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:44.057581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d56ce714-f88c-4fd9-8637-bb1ba7279ad9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:44.058074 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d56ce714-f88c-4fd9-8637-bb1ba7279ad9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:44.058511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d56ce714-f88c-4fd9-8637-bb1ba7279ad9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:44.099842 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d56ce714-f88c-4fd9-8637-bb1ba7279ad9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058218 Sep 14 12:13:44.100427 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 404/810] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Sep 14 12:13:44 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:13:45.118593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0be56c3f-cb5c-482c-9d84-fd7d42e11089 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:45.126163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0be56c3f-cb5c-482c-9d84-fd7d42e11089 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:45.127788 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0be56c3f-cb5c-482c-9d84-fd7d42e11089 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:45.128280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0be56c3f-cb5c-482c-9d84-fd7d42e11089 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:45.128713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0be56c3f-cb5c-482c-9d84-fd7d42e11089 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:45.129418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0be56c3f-cb5c-482c-9d84-fd7d42e11089 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:45.129886 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0be56c3f-cb5c-482c-9d84-fd7d42e11089 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:45.130316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0be56c3f-cb5c-482c-9d84-fd7d42e11089 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:45.164113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0be56c3f-cb5c-482c-9d84-fd7d42e11089 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054119 Sep 14 12:13:45.164692 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 407/811] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Sep 14 12:13:45 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:13:45.233904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-432330a8-f63b-4af0-8079-e7d96dd70b0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:45.234477 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-432330a8-f63b-4af0-8079-e7d96dd70b0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:45.241354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432330a8-f63b-4af0-8079-e7d96dd70b0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:45.241814 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432330a8-f63b-4af0-8079-e7d96dd70b0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:45.242297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432330a8-f63b-4af0-8079-e7d96dd70b0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:45.242993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432330a8-f63b-4af0-8079-e7d96dd70b0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:45.243437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432330a8-f63b-4af0-8079-e7d96dd70b0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:45.243926 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-432330a8-f63b-4af0-8079-e7d96dd70b0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:45.270694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-432330a8-f63b-4af0-8079-e7d96dd70b0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:13:45.592678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-432330a8-f63b-4af0-8079-e7d96dd70b0c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 204 len: 0 microversion: 2.20 time: 0.362480 Sep 14 12:13:45.595777 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 405/812] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Sep 14 12:13:45 2022] DELETE /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 12:13:45.602440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:45.603051 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:45.609733 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:45.610251 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:45.610682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:45.611378 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:45.611829 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:45.612249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:45.748515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:45.756691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:45.758204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:45.759385 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0977da40-aacb-4ecc-bad3-1652c6cd563f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.161655 Sep 14 12:13:45.759946 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 408/813] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:13:45 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:13:46.785675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:46.786391 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:46.793645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:46.794174 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:46.794780 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:46.795618 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:46.795979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:46.796416 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:47.234288 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:47.243338 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:47.244787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:47.246006 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dd18da07-1581-42ba-8a0b-211b6b12c9ae tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.464964 Sep 14 12:13:47.246577 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 406/814] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:13:46 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:13:48.272242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:48.273469 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:48.279686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:48.280180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:48.280617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:48.281306 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:48.281759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:48.282211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:48.450099 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:48.458409 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:48.459890 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:48.461049 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-78e8f4b0-fa36-42da-aadc-2d337f18ce29 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1723 microversion: 2.20 time: 0.193305 Sep 14 12:13:48.461599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 409/815] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:13:48 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:13:49.351440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-b6853eea-37aa-4053-b701-4c363183733f req-3d189dd2-f416-4694-a466-4bd040cfba3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b1312a-8b45-4481-9a44-f330379d0c8f", "name": "network-vif-deleted", "tag": "906fb0c9-14b7-4949-943a-c084b122ae8b"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:13:49.362778 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b6853eea-37aa-4053-b701-4c363183733f req-3d189dd2-f416-4694-a466-4bd040cfba3a service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:49.365403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b6853eea-37aa-4053-b701-4c363183733f req-3d189dd2-f416-4694-a466-4bd040cfba3a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:49.365403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-b6853eea-37aa-4053-b701-4c363183733f req-3d189dd2-f416-4694-a466-4bd040cfba3a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:49.378468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-b6853eea-37aa-4053-b701-4c363183733f req-3d189dd2-f416-4694-a466-4bd040cfba3a service nova] Creating event network-vif-deleted:906fb0c9-14b7-4949-943a-c084b122ae8b for instance b7b1312a-8b45-4481-9a44-f330379d0c8f on hv-cinder-84496 Sep 14 12:13:49.385261 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-b6853eea-37aa-4053-b701-4c363183733f req-3d189dd2-f416-4694-a466-4bd040cfba3a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037571 Sep 14 12:13:49.385882 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 407/816] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:13:49.486958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:49.488310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:49.495517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:49.495999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:49.496457 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:49.497148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:49.497598 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:49.498066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:49.567137 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:49.578961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:49.580833 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:49.582139 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-72e6962f-a68d-459b-982a-b1bcb52fb976 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1656 microversion: 2.20 time: 0.099217 Sep 14 12:13:49.582951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 410/817] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:13:49 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1656 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:13:50.620677 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:50.622105 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:50.631306 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:50.631852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:50.632517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:50.633712 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:50.634233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:50.634665 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:50.672803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:50.673373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:50.673808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:50.674323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lazy-loading 'fault' on Instance uuid b7b1312a-8b45-4481-9a44-f330379d0c8f {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:13:50.732939 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:50.745128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:50.747046 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:50.747949 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7618574c-6c4a-4ebf-b690-170eca4e6985 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 200 len: 1371 microversion: 2.20 time: 0.133192 Sep 14 12:13:50.749154 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 408/818] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:13:50 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:13:51.773721 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:51.774607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:51.781490 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:51.782214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:51.782700 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:51.783540 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:51.784039 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:51.784513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:51.805287 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] HTTP exception thrown: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Request method failure captured: Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f HTTP/1.1 Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOwDapskpoCqu5EFnt8nv7zDnixAUA_TemLf3fQlRz6qRE5K-yIEgqSGM8glrH9e04MCVU7qWBH7NuBSfBtlrH9m-gLGgoo-5YU4fV79tLIrcofYeMFmRxT1hNgIkCVxnJtMZBCN58seJOIquY3L4oytfH0QK1DMpeR2DN5Qn7YIdY Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:13:51.806971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}] Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 28e44067e07d4501a840108f4dcf053c Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:13:51.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'b7b1312a-8b45-4481-9a44-f330379d0c8f'} Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:13:51.809531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:13:51.811016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:13:51.812204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Returning 404 to user: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:13:51.812204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-75ff69c7-66e1-4e20-be27-0342c8bd761c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 404 len: 111 microversion: 2.20 time: 0.039318 Sep 14 12:13:51.812204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 411/819] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:13:51 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 14 12:13:51.817392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-738c75d0-f634-4797-8aac-3beb948fb1c1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '.version_select at 0x7f1c9d452e50>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:51.965214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-738c75d0-f634-4797-8aac-3beb948fb1c1 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-831008875" status: 204 len: 0 microversion: 2.20 time: 0.151622 Sep 14 12:13:51.965816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 409/820] 10.222.0.62 () {60 vars in 1259 bytes} [Wed Sep 14 12:13:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-831008875 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 12:13:52.958117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fa5fb9aa-93e1-48a4-9acc-df4bd2f122b9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Action: 'create', calling method: .version_select at 0x7f1c99beab80>, body: {"keypair": {"name": "tempest-keypair-1947154319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKocMVj9vb0kcfEOh4J+8H88AqywIfBo2YeBVYfc1jxk53Rx5ZkzHumMncr/56DCMuaUUBUSFfh0SRkHbRCSblH3WFYDcxOMbdsILTPtDEyGG3d2SF1uzE7bcqQHngHyA=="}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:13:52.975023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-fa5fb9aa-93e1-48a4-9acc-df4bd2f122b9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Getting quotas for project d410170ed3ed4ce2b64d367cbf77790a. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:13:52.980860 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-fa5fb9aa-93e1-48a4-9acc-df4bd2f122b9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Getting quotas for user 28e44067e07d4501a840108f4dcf053c and project d410170ed3ed4ce2b64d367cbf77790a. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:13:53.097029 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-fa5fb9aa-93e1-48a4-9acc-df4bd2f122b9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.142936 Sep 14 12:13:53.100013 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 412/821] 10.222.0.62 () {62 vars in 1200 bytes} [Wed Sep 14 12:13:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 12:13:55.638177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-759055473", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ca6a8c3-1298-4a9f-a110-741bf377213f"}], "security_groups": [{"name": "tempest-securitygroup--130254157"}], "key_name": "tempest-keypair-1947154319", "user_data": "}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:13:55.742015 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] validate_networks() for [('0ca6a8c3-1298-4a9f-a110-741bf377213f', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:13:56.244373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:13:56.244828 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:13:56.245307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:13:56.245719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:13:56.246164 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:13:56.254970 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:56.255451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:56.255889 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:56.256661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:56.257697 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:56.258158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:56.275391 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Getting quotas for project d410170ed3ed4ce2b64d367cbf77790a. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:13:56.279555 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Getting quotas for user 28e44067e07d4501a840108f4dcf053c and project d410170ed3ed4ce2b64d367cbf77790a. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:13:56.290732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:13:56.293035 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:13:56.425432 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b7b62986-b02b-4415-9347-f738874b4ced tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.792579 Sep 14 12:13:56.426186 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 410/822] 10.222.0.62 () {62 vars in 1188 bytes} [Wed Sep 14 12:13:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 14 12:13:56.437784 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a6c6ac88-cbc4-4291-8014-e1d05c81f9e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:56.438457 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a6c6ac88-cbc4-4291-8014-e1d05c81f9e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:56.491744 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a6c6ac88-cbc4-4291-8014-e1d05c81f9e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:56.500943 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a6c6ac88-cbc4-4291-8014-e1d05c81f9e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:56.500943 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a6c6ac88-cbc4-4291-8014-e1d05c81f9e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:56.501910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a6c6ac88-cbc4-4291-8014-e1d05c81f9e2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1281 microversion: 2.20 time: 0.068031 Sep 14 12:13:56.502473 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 413/823] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:13:56 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:13:57.527654 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:57.528292 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:57.534378 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:57.534904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:57.535362 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:57.536048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:57.536504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:57.536933 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:57.604301 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:57.612467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:57.613917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:57.615068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ebccdef5-066d-4b6a-9d0f-8186f7fe9c3e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1285 microversion: 2.20 time: 0.092719 Sep 14 12:13:57.615629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 411/824] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:13:57 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:13:58.640818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:58.641419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:58.648481 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:58.649070 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:58.650233 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:58.650523 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:58.650864 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:58.651282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:58.716149 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:58.724468 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:58.725962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:13:58.727099 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-eec39cc7-04aa-4f70-976b-b3b33926daf0 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1333 microversion: 2.20 time: 0.090328 Sep 14 12:13:58.727653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 414/825] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:13:58 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:13:59.751941 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:13:59.753058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:13:59.759374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:59.759868 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:59.760311 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:13:59.761010 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:13:59.761525 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:13:59.761904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:00.276854 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:00.286446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:00.288460 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:00.289973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b142f98c-46b9-43c5-84de-796302b1f8f2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1406 microversion: 2.20 time: 0.541652 Sep 14 12:14:00.290545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 412/826] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:13:59 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1406 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:14:00.928078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-202a557c-67e2-434b-b764-56113f255aee req-b6b821a3-f6b9-4077-860d-6260eaab83f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8a5c35-addb-48f1-928a-c53c742fbe4c", "tag": "bfea540b-fd0e-472b-8c6b-76b61ec6c980"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:00.939257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-202a557c-67e2-434b-b764-56113f255aee req-b6b821a3-f6b9-4077-860d-6260eaab83f5 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:00.942247 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-202a557c-67e2-434b-b764-56113f255aee req-b6b821a3-f6b9-4077-860d-6260eaab83f5 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:00.942247 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-202a557c-67e2-434b-b764-56113f255aee req-b6b821a3-f6b9-4077-860d-6260eaab83f5 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:00.952287 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-202a557c-67e2-434b-b764-56113f255aee req-b6b821a3-f6b9-4077-860d-6260eaab83f5 service nova] Creating event network-changed:bfea540b-fd0e-472b-8c6b-76b61ec6c980 for instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c on hv-cinder-84496 Sep 14 12:14:00.958060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-202a557c-67e2-434b-b764-56113f255aee req-b6b821a3-f6b9-4077-860d-6260eaab83f5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033883 Sep 14 12:14:00.958736 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 415/827] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:01.316876 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:01.317739 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:01.324002 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:01.324488 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:01.324921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:01.325611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:01.326101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:01.326528 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:01.456335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:01.464964 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:01.466518 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:01.467624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-edd35764-f8fd-4d9c-a0f2-09cbb0ddf38c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1406 microversion: 2.20 time: 0.154978 Sep 14 12:14:01.468190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 413/828] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:14:01 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:14:02.494100 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:02.494801 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:02.501569 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:02.502109 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:02.502548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:02.503242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:02.503689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:02.504110 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:02.638310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:02.646470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:02.647898 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:02.649036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2d356193-cb27-4f75-9f31-88008684b19f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1406 microversion: 2.20 time: 0.159798 Sep 14 12:14:02.649842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 416/829] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:14:02 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:14:03.674640 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:03.675190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:03.682136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:03.682623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:03.683065 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:03.683762 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:03.684213 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:03.684639 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:03.815113 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:03.824119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:03.826280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:03.826743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fd6be596-56af-488c-9de3-83d866759052 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1406 microversion: 2.20 time: 0.156051 Sep 14 12:14:03.827507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 414/830] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:14:03 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:14:04.851622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:04.853612 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:04.860305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:04.860644 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:04.860909 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:04.861610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:04.862091 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:04.862942 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:05.027719 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:05.037344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:05.038873 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:05.040093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5a5abbdf-934f-41be-9ccc-7e99d1707213 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1406 microversion: 2.20 time: 0.192513 Sep 14 12:14:05.040670 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 417/831] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:14:04 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:14:06.065734 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:06.066557 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:06.073822 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:06.074339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:06.074779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:06.075715 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:06.076048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:06.076477 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:06.219302 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:06.228339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:06.229777 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:06.230913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-11f5065f-1de3-482f-a537-078f18c76300 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1406 microversion: 2.20 time: 0.169236 Sep 14 12:14:06.231472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 415/832] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:14:06 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:14:07.208921 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-440a276f-3e89-46e4-bf45-ce4ed8a31417 req-178dd669-98a3-4959-a3f2-4c38c55782be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8a5c35-addb-48f1-928a-c53c742fbe4c", "name": "network-vif-plugged", "status": "completed", "tag": "bfea540b-fd0e-472b-8c6b-76b61ec6c980"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:07.215541 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=6 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:07.221160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-440a276f-3e89-46e4-bf45-ce4ed8a31417 req-178dd669-98a3-4959-a3f2-4c38c55782be service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:07.221642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-440a276f-3e89-46e4-bf45-ce4ed8a31417 req-178dd669-98a3-4959-a3f2-4c38c55782be service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:07.222181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-440a276f-3e89-46e4-bf45-ce4ed8a31417 req-178dd669-98a3-4959-a3f2-4c38c55782be service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:07.233651 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-440a276f-3e89-46e4-bf45-ce4ed8a31417 req-178dd669-98a3-4959-a3f2-4c38c55782be service nova] Creating event network-vif-plugged:bfea540b-fd0e-472b-8c6b-76b61ec6c980 for instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c on hv-cinder-84496 Sep 14 12:14:07.241661 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-440a276f-3e89-46e4-bf45-ce4ed8a31417 req-178dd669-98a3-4959-a3f2-4c38c55782be service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033830 Sep 14 12:14:07.241661 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 418/833] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:07.257990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:07.258810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:07.260786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:07.261442 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=6 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:07.266585 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:07.267069 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:07.267500 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:07.268187 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:07.268633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:07.269050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:07.412260 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:07.421932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:07.423754 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:07.424884 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8341ac6a-826b-407a-9a12-5da38c00beba tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1406 microversion: 2.20 time: 0.171715 Sep 14 12:14:07.425453 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 416/834] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:14:07 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:14:08.451061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:08.451779 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:08.458462 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:08.458941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:08.459366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:08.460045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:08.460492 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:08.460907 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:08.601290 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:08.609658 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:08.611145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:08.612226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-407e55f8-66b7-4fd9-b269-f742a5a36bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1406 microversion: 2.20 time: 0.165862 Sep 14 12:14:08.612791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 419/835] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:14:08 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:14:09.637638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:09.638317 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:09.645235 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:09.645811 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:09.646280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:09.646984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:09.647932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:09.648361 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:09.785499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:09.796743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:09.799301 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:09.800608 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7d30bb36-4ac4-47f9-860b-c5153176cb5f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1406 microversion: 2.20 time: 0.167833 Sep 14 12:14:09.801176 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 417/836] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:14:09 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:14:10.826357 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:10.827553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:10.835667 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:10.836158 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:10.836879 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:10.837271 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:10.837716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:10.838168 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:10.984875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:10.994309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:10.995808 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:10.996966 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-31e9d37b-469b-401f-91fe-78d161a8b787 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1597 microversion: 2.20 time: 0.174805 Sep 14 12:14:10.997528 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 420/837] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:14:10 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:14:11.022714 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-32a860fe-b0f0-43f5-b71b-c9c0899d8740 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:11.023318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-32a860fe-b0f0-43f5-b71b-c9c0899d8740 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:11.030309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a860fe-b0f0-43f5-b71b-c9c0899d8740 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:11.030799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a860fe-b0f0-43f5-b71b-c9c0899d8740 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:11.031244 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a860fe-b0f0-43f5-b71b-c9c0899d8740 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:11.032004 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a860fe-b0f0-43f5-b71b-c9c0899d8740 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:11.032459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a860fe-b0f0-43f5-b71b-c9c0899d8740 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:11.032919 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32a860fe-b0f0-43f5-b71b-c9c0899d8740 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:11.121063 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-32a860fe-b0f0-43f5-b71b-c9c0899d8740 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102429 Sep 14 12:14:11.121664 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 418/838] 10.222.0.62 () {60 vars in 1316 bytes} [Wed Sep 14 12:14:11 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:14:12.225002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-85774743-9684-4221-bb7c-6b97c8a230a4 req-5e4ebbe0-ea67-482d-871f-bc70091e857a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8a5c35-addb-48f1-928a-c53c742fbe4c", "tag": "bfea540b-fd0e-472b-8c6b-76b61ec6c980"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:12.236575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-85774743-9684-4221-bb7c-6b97c8a230a4 req-5e4ebbe0-ea67-482d-871f-bc70091e857a service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:12.236575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-85774743-9684-4221-bb7c-6b97c8a230a4 req-5e4ebbe0-ea67-482d-871f-bc70091e857a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:12.237038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-85774743-9684-4221-bb7c-6b97c8a230a4 req-5e4ebbe0-ea67-482d-871f-bc70091e857a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:12.249116 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-85774743-9684-4221-bb7c-6b97c8a230a4 req-5e4ebbe0-ea67-482d-871f-bc70091e857a service nova] Creating event network-changed:bfea540b-fd0e-472b-8c6b-76b61ec6c980 for instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c on hv-cinder-84496 Sep 14 12:14:12.254831 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-85774743-9684-4221-bb7c-6b97c8a230a4 req-5e4ebbe0-ea67-482d-871f-bc70091e857a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036130 Sep 14 12:14:12.255448 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 421/839] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:21.292237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:21.293072 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:21.515524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7980a5ed-29b1-4b24-8aff-4bb2e2bce1d0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:21.516014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7980a5ed-29b1-4b24-8aff-4bb2e2bce1d0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:21.522370 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7980a5ed-29b1-4b24-8aff-4bb2e2bce1d0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:21.523512 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7980a5ed-29b1-4b24-8aff-4bb2e2bce1d0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:21.523808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7980a5ed-29b1-4b24-8aff-4bb2e2bce1d0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:21.524844 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7980a5ed-29b1-4b24-8aff-4bb2e2bce1d0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:21.525214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7980a5ed-29b1-4b24-8aff-4bb2e2bce1d0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:21.525634 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7980a5ed-29b1-4b24-8aff-4bb2e2bce1d0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:21.550929 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7980a5ed-29b1-4b24-8aff-4bb2e2bce1d0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953/ips" status: 200 len: 150 microversion: 2.1 time: 0.260321 Sep 14 12:14:21.551694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 419/840] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 14 12:14:21 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953/ips => generated 150 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:21.565019 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbee5dec-9cc7-4e9c-9b6b-563e1491f357"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:21.568216 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:21.569582 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:21.574570 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:21.575055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:21.575492 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:21.576208 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:21.576663 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:21.577107 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:21.579625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=75 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:21.668056 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Invalid volume: volume cbee5dec-9cc7-4e9c-9b6b-563e1491f357 is already attached to instances: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: POST /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953/os-volume_attachments HTTP/1.1 Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 74 Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:14:21.671079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {"volumeAttachment": {"volumeId": "cbee5dec-9cc7-4e9c-9b6b-563e1491f357"}} Sep 14 12:14:21.673368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Invalid volume: volume cbee5dec-9cc7-4e9c-9b6b-563e1491f357 is already attached to instances: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'server_id': '16fe551f-effb-4a0a-b0c2-b4bc82178953', 'body': {'volumeAttachment': {'volumeId': 'cbee5dec-9cc7-4e9c-9b6b-563e1491f357'}}} Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cbee5dec-9cc7-4e9c-9b6b-563e1491f357 is already attached to instances: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:21.674664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cbee5dec-9cc7-4e9c-9b6b-563e1491f357 is already attached to instances: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:21.675962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:14:21.678000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:14:21.678000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:14:21.678000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:14:21.678000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cbee5dec-9cc7-4e9c-9b6b-563e1491f357 is already attached to instances: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 Sep 14 12:14:21.678000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:21.678000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 400 to user: Invalid volume: volume cbee5dec-9cc7-4e9c-9b6b-563e1491f357 is already attached to instances: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:14:21.678000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0ca6b935-231e-46b3-8bb5-1b68abf73c5b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111686 Sep 14 12:14:21.678000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 422/841] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:14:21 2022] POST /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 12:14:21.685938 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7c80a49c-9dfe-454b-bf77-7284812d1256 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:21.686446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7c80a49c-9dfe-454b-bf77-7284812d1256 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:21.692920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c80a49c-9dfe-454b-bf77-7284812d1256 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:21.693413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c80a49c-9dfe-454b-bf77-7284812d1256 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:21.693924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c80a49c-9dfe-454b-bf77-7284812d1256 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:21.694875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c80a49c-9dfe-454b-bf77-7284812d1256 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:21.695339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c80a49c-9dfe-454b-bf77-7284812d1256 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:21.695766 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c80a49c-9dfe-454b-bf77-7284812d1256 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:21.722491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7c80a49c-9dfe-454b-bf77-7284812d1256 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:14:22.215554 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7c80a49c-9dfe-454b-bf77-7284812d1256 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 204 len: 0 microversion: 2.1 time: 0.536297 Sep 14 12:14:22.216159 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 420/842] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:14:21 2022] DELETE /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 12:14:22.224526 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4894cb7a-d823-4c8b-bf6a-5f4777f7a9d1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:22.225143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4894cb7a-d823-4c8b-bf6a-5f4777f7a9d1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:22.232410 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4894cb7a-d823-4c8b-bf6a-5f4777f7a9d1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:22.232894 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4894cb7a-d823-4c8b-bf6a-5f4777f7a9d1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:22.233332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4894cb7a-d823-4c8b-bf6a-5f4777f7a9d1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:22.234068 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4894cb7a-d823-4c8b-bf6a-5f4777f7a9d1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:22.234521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4894cb7a-d823-4c8b-bf6a-5f4777f7a9d1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:22.234951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4894cb7a-d823-4c8b-bf6a-5f4777f7a9d1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:22.380373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4894cb7a-d823-4c8b-bf6a-5f4777f7a9d1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:22.388356 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4894cb7a-d823-4c8b-bf6a-5f4777f7a9d1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1682 microversion: 2.1 time: 0.167699 Sep 14 12:14:22.388935 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 423/843] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:22 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:23.413660 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cc59a2ab-5866-4a00-8458-7f8c7bb3a85c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:23.414393 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cc59a2ab-5866-4a00-8458-7f8c7bb3a85c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:23.421075 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc59a2ab-5866-4a00-8458-7f8c7bb3a85c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:23.421575 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc59a2ab-5866-4a00-8458-7f8c7bb3a85c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:23.422078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc59a2ab-5866-4a00-8458-7f8c7bb3a85c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:23.422784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc59a2ab-5866-4a00-8458-7f8c7bb3a85c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:23.423237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc59a2ab-5866-4a00-8458-7f8c7bb3a85c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:23.423672 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cc59a2ab-5866-4a00-8458-7f8c7bb3a85c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:23.558319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cc59a2ab-5866-4a00-8458-7f8c7bb3a85c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:23.566238 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cc59a2ab-5866-4a00-8458-7f8c7bb3a85c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1682 microversion: 2.1 time: 0.156888 Sep 14 12:14:23.566806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 421/844] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:23 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:24.591347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c085277f-bea5-4e01-b87c-668712ef816e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:24.591997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c085277f-bea5-4e01-b87c-668712ef816e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:24.598602 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085277f-bea5-4e01-b87c-668712ef816e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:24.599091 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085277f-bea5-4e01-b87c-668712ef816e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:24.599528 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085277f-bea5-4e01-b87c-668712ef816e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:24.600231 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085277f-bea5-4e01-b87c-668712ef816e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:24.600719 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085277f-bea5-4e01-b87c-668712ef816e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:24.601152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c085277f-bea5-4e01-b87c-668712ef816e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:25.092157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c085277f-bea5-4e01-b87c-668712ef816e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:25.099932 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c085277f-bea5-4e01-b87c-668712ef816e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1682 microversion: 2.1 time: 0.513323 Sep 14 12:14:25.100544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 424/845] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:24 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1682 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:25.646395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-0f082a66-6568-4057-b6c2-a8d5b42af27e req-4779d725-4430-4122-a45b-234fa98e81b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fe551f-effb-4a0a-b0c2-b4bc82178953", "name": "network-vif-deleted", "tag": "d4d61e40-b11d-4281-b965-9796c5ee7fce"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:25.658579 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0f082a66-6568-4057-b6c2-a8d5b42af27e req-4779d725-4430-4122-a45b-234fa98e81b1 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:25.659064 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0f082a66-6568-4057-b6c2-a8d5b42af27e req-4779d725-4430-4122-a45b-234fa98e81b1 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:25.659491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0f082a66-6568-4057-b6c2-a8d5b42af27e req-4779d725-4430-4122-a45b-234fa98e81b1 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:25.673038 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-0f082a66-6568-4057-b6c2-a8d5b42af27e req-4779d725-4430-4122-a45b-234fa98e81b1 service nova] Creating event network-vif-deleted:d4d61e40-b11d-4281-b965-9796c5ee7fce for instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 on hv-cinder-84496 Sep 14 12:14:25.678625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-0f082a66-6568-4057-b6c2-a8d5b42af27e req-4779d725-4430-4122-a45b-234fa98e81b1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035593 Sep 14 12:14:25.680106 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 422/846] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:26.126751 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:26.130712 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:26.136150 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:26.136646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:26.137085 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:26.137797 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:26.138300 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:26.138711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:26.173731 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:26.174269 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:26.174938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:26.175832 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lazy-loading 'fault' on Instance uuid 16fe551f-effb-4a0a-b0c2-b4bc82178953 {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:14:26.227804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:26.236255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-de2eccce-8c64-4e26-ae55-f2cb4ece7975 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1331 microversion: 2.1 time: 0.115750 Sep 14 12:14:26.236851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 425/847] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:26 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:27.262357 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:27.262969 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:27.269506 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:27.270025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:27.270477 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:27.271195 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:27.271649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:27.272082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:27.306468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:27.306950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:27.307383 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:27.307824 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lazy-loading 'fault' on Instance uuid 16fe551f-effb-4a0a-b0c2-b4bc82178953 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:14:27.351778 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:27.368898 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-32367597-68ce-4a99-acae-cda97725db95 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 200 len: 1331 microversion: 2.1 time: 0.110820 Sep 14 12:14:27.369504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 423/848] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:27 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:28.395572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:28.396223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:28.403390 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:28.403903 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:28.404344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:28.405071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:28.405525 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:28.405984 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:28.420148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 HTTP/1.1 Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:14:28.421730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:14:28.423122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '16fe551f-effb-4a0a-b0c2-b4bc82178953'} Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:14:28.423887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:14:28.425174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:28.426570 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:14:28.426570 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5dd8f4e0-264b-4023-b921-dd2441740e6f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 404 len: 111 microversion: 2.1 time: 0.033997 Sep 14 12:14:28.426570 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 426/849] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:28 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:14:28.433250 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-eeb80da7-e7d3-4f2b-bbd1-0fafe950aea0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '.version_select at 0x7f1c9d49a820>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:28.532278 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-eeb80da7-e7d3-4f2b-bbd1-0fafe950aea0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361228140" status: 202 len: 0 microversion: 2.1 time: 0.103590 Sep 14 12:14:28.532876 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 424/850] 10.222.0.62 () {58 vars in 1221 bytes} [Wed Sep 14 12:14:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361228140 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:14:29.612706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2020985e-8689-40bf-9092-190a7a22fa88 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:29.613291 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2020985e-8689-40bf-9092-190a7a22fa88 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:29.619837 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2020985e-8689-40bf-9092-190a7a22fa88 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:29.620317 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2020985e-8689-40bf-9092-190a7a22fa88 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:29.620748 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2020985e-8689-40bf-9092-190a7a22fa88 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:29.621436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2020985e-8689-40bf-9092-190a7a22fa88 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:29.621912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2020985e-8689-40bf-9092-190a7a22fa88 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:29.622341 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2020985e-8689-40bf-9092-190a7a22fa88 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:29.704802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-2020985e-8689-40bf-9092-190a7a22fa88 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lazy-loading 'services' on Instance uuid c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:14:29.902421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2020985e-8689-40bf-9092-190a7a22fa88 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-volume_attachments/cbee5dec-9cc7-4e9c-9b6b-563e1491f357" status: 202 len: 0 microversion: 2.1 time: 0.299816 Sep 14 12:14:29.902994 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 427/851] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:14:29 2022] DELETE /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-volume_attachments/cbee5dec-9cc7-4e9c-9b6b-563e1491f357 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:14:29.912345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cea6efac-a725-4ad9-a53a-7cadc7c74ef6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:29.914619 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cea6efac-a725-4ad9-a53a-7cadc7c74ef6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:29.921443 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cea6efac-a725-4ad9-a53a-7cadc7c74ef6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:29.921957 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cea6efac-a725-4ad9-a53a-7cadc7c74ef6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:29.922393 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cea6efac-a725-4ad9-a53a-7cadc7c74ef6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:29.923169 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cea6efac-a725-4ad9-a53a-7cadc7c74ef6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:29.923546 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cea6efac-a725-4ad9-a53a-7cadc7c74ef6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:29.923972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cea6efac-a725-4ad9-a53a-7cadc7c74ef6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:29.954474 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cea6efac-a725-4ad9-a53a-7cadc7c74ef6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046641 Sep 14 12:14:29.955037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 425/852] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:14:29 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:30.968379 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e85c7ac2-4a6a-44d6-b61b-457feceaffcf tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:30.970881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e85c7ac2-4a6a-44d6-b61b-457feceaffcf tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:30.977675 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e85c7ac2-4a6a-44d6-b61b-457feceaffcf tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:30.978690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e85c7ac2-4a6a-44d6-b61b-457feceaffcf tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:30.979129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e85c7ac2-4a6a-44d6-b61b-457feceaffcf tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:30.980076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e85c7ac2-4a6a-44d6-b61b-457feceaffcf tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:30.980550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e85c7ac2-4a6a-44d6-b61b-457feceaffcf tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:30.980978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e85c7ac2-4a6a-44d6-b61b-457feceaffcf tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:31.016264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e85c7ac2-4a6a-44d6-b61b-457feceaffcf tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053030 Sep 14 12:14:31.016852 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 428/853] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:14:30 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:32.029914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3526c725-c902-4860-a6f2-451cb3e8381d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:32.032144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3526c725-c902-4860-a6f2-451cb3e8381d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:32.039081 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3526c725-c902-4860-a6f2-451cb3e8381d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:32.041938 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3526c725-c902-4860-a6f2-451cb3e8381d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:32.041938 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3526c725-c902-4860-a6f2-451cb3e8381d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:32.041938 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3526c725-c902-4860-a6f2-451cb3e8381d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:32.041938 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3526c725-c902-4860-a6f2-451cb3e8381d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:32.042406 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3526c725-c902-4860-a6f2-451cb3e8381d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:32.073147 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3526c725-c902-4860-a6f2-451cb3e8381d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047182 Sep 14 12:14:32.073729 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 426/854] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:14:32 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 12:14:32.141841 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-223752b6-f11f-40db-b971-aaa312fb40af tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:32.144879 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-223752b6-f11f-40db-b971-aaa312fb40af tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:32.152998 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-223752b6-f11f-40db-b971-aaa312fb40af tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:32.153936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-223752b6-f11f-40db-b971-aaa312fb40af tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:32.154697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-223752b6-f11f-40db-b971-aaa312fb40af tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:32.155998 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-223752b6-f11f-40db-b971-aaa312fb40af tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:32.156640 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-223752b6-f11f-40db-b971-aaa312fb40af tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:32.157338 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-223752b6-f11f-40db-b971-aaa312fb40af tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:32.188844 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-223752b6-f11f-40db-b971-aaa312fb40af tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Going to try to terminate instance {{(pid=121152) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:14:32.480354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-223752b6-f11f-40db-b971-aaa312fb40af tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 204 len: 0 microversion: 2.1 time: 0.343177 Sep 14 12:14:32.480950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 429/855] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:14:32 2022] DELETE /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:14:32.489169 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b6612a94-22c0-4355-99eb-9c41fb39caae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:32.499693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b6612a94-22c0-4355-99eb-9c41fb39caae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:32.499693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6612a94-22c0-4355-99eb-9c41fb39caae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:32.499693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6612a94-22c0-4355-99eb-9c41fb39caae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:32.499693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6612a94-22c0-4355-99eb-9c41fb39caae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:32.500097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6612a94-22c0-4355-99eb-9c41fb39caae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:32.500097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6612a94-22c0-4355-99eb-9c41fb39caae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:32.500097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b6612a94-22c0-4355-99eb-9c41fb39caae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:32.632319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b6612a94-22c0-4355-99eb-9c41fb39caae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:32.640144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b6612a94-22c0-4355-99eb-9c41fb39caae tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1680 microversion: 2.1 time: 0.154801 Sep 14 12:14:32.640719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 427/856] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:32 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:33.664995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4f291fba-7682-4e16-81c0-e24eb5113d66 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:33.665683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4f291fba-7682-4e16-81c0-e24eb5113d66 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:33.672230 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4f291fba-7682-4e16-81c0-e24eb5113d66 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:33.672711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4f291fba-7682-4e16-81c0-e24eb5113d66 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:33.673145 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4f291fba-7682-4e16-81c0-e24eb5113d66 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:33.673827 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4f291fba-7682-4e16-81c0-e24eb5113d66 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:33.674297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4f291fba-7682-4e16-81c0-e24eb5113d66 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:33.674716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4f291fba-7682-4e16-81c0-e24eb5113d66 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:33.807201 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4f291fba-7682-4e16-81c0-e24eb5113d66 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:33.815614 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4f291fba-7682-4e16-81c0-e24eb5113d66 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1680 microversion: 2.1 time: 0.154850 Sep 14 12:14:33.816884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 430/857] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:33 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:34.778412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-22505f1d-4c44-4164-b385-3b5a1d3dc84a req-91821e1a-75cc-4473-8d6e-2d696138f62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8", "name": "network-vif-deleted", "tag": "97f1a3f8-15d4-41fb-82b2-8ab9cec6e359"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:34.789088 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-22505f1d-4c44-4164-b385-3b5a1d3dc84a req-91821e1a-75cc-4473-8d6e-2d696138f62a service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:34.789735 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-22505f1d-4c44-4164-b385-3b5a1d3dc84a req-91821e1a-75cc-4473-8d6e-2d696138f62a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:34.791711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-22505f1d-4c44-4164-b385-3b5a1d3dc84a req-91821e1a-75cc-4473-8d6e-2d696138f62a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:34.802153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-22505f1d-4c44-4164-b385-3b5a1d3dc84a req-91821e1a-75cc-4473-8d6e-2d696138f62a service nova] Creating event network-vif-deleted:97f1a3f8-15d4-41fb-82b2-8ab9cec6e359 for instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 on hv-cinder-84496 Sep 14 12:14:34.807362 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-22505f1d-4c44-4164-b385-3b5a1d3dc84a req-91821e1a-75cc-4473-8d6e-2d696138f62a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033803 Sep 14 12:14:34.808003 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 428/858] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:34.839578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9a651109-e94d-4660-b035-4ef2f7d6f95c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:34.840275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9a651109-e94d-4660-b035-4ef2f7d6f95c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:34.850046 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a651109-e94d-4660-b035-4ef2f7d6f95c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:34.850626 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a651109-e94d-4660-b035-4ef2f7d6f95c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:34.851137 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a651109-e94d-4660-b035-4ef2f7d6f95c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:34.851912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a651109-e94d-4660-b035-4ef2f7d6f95c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:34.852575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a651109-e94d-4660-b035-4ef2f7d6f95c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:34.853057 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a651109-e94d-4660-b035-4ef2f7d6f95c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:34.933438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9a651109-e94d-4660-b035-4ef2f7d6f95c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:34.941805 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9a651109-e94d-4660-b035-4ef2f7d6f95c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1613 microversion: 2.1 time: 0.106986 Sep 14 12:14:34.943083 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 431/859] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:34 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1613 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:35.968310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:35.969148 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:35.975415 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:35.979367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:35.979367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:35.979367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:35.979367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:35.980286 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:36.011279 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:36.011755 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:36.012263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:36.012682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lazy-loading 'fault' on Instance uuid c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:14:36.054540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:36.062930 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ff7d6a97-9ec6-49f1-aa17-1334285291b6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 200 len: 1330 microversion: 2.1 time: 0.099423 Sep 14 12:14:36.063511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 429/860] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:35 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:37.091601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:37.092246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:37.099782 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:37.100461 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:37.100706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:37.101428 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:37.101912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:37.102341 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:37.116472 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 HTTP/1.1 Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:14:37.118595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:14:37.120867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8'} Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:14:37.122030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:14:37.123636 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:14:37.125555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:14:37.125555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7937bfd5-3f2c-4b19-b362-2ae2ee16d1e9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 404 len: 111 microversion: 2.1 time: 0.032842 Sep 14 12:14:37.125555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 432/861] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:37 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:14:37.130154 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e3bd8370-a03e-43e3-9153-5389e0515717 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '.version_select at 0x7f1c9d49adc0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:37.224476 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e3bd8370-a03e-43e3-9153-5389e0515717 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-37883818" status: 202 len: 0 microversion: 2.1 time: 0.098198 Sep 14 12:14:37.225070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 430/862] 10.222.0.62 () {58 vars in 1215 bytes} [Wed Sep 14 12:14:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-37883818 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 12:14:38.089560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5ebbc929-df5f-48d0-a677-0d283d283e6d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: .version_select at 0x7f1c99baf0d0>, body: {"keypair": {"name": "tempest-keypair-1417724504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzkdEhwyc616FgC2R/5VFn2MhXDK3bNOEI++79XchYNUcrQHL1eUNi5zGmlGQBZ1c5/DrooWv2fA+LszLrjgwfCahIMhbLsvcUmgExCGVC2G1EsV/x+PmoPqQqptQNnsg=="}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:38.107823 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-5ebbc929-df5f-48d0-a677-0d283d283e6d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for project 5b86ec91335c49aaa672aa85461d2936. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:14:38.112587 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-5ebbc929-df5f-48d0-a677-0d283d283e6d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for user 31f3271adc36406fb303fb169020e740 and project 5b86ec91335c49aaa672aa85461d2936. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:14:38.202273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5ebbc929-df5f-48d0-a677-0d283d283e6d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117053 Sep 14 12:14:38.202914 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 433/863] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 14 12:14:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:41.434752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-338187899", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf307d40-f42c-4be6-8979-65e762517b0f"}], "security_groups": [{"name": "tempest-securitygroup--1052161922"}], "key_name": "tempest-keypair-1417724504", "user_data": "}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:41.542231 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] validate_networks() for [('cf307d40-f42c-4be6-8979-65e762517b0f', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:14:41.930163 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:14:41.930584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:14:41.931055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:14:41.931459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:14:41.931871 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:14:41.940820 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:41.941420 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:41.941852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:41.942604 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:41.943052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:41.943471 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:41.962301 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for project 5b86ec91335c49aaa672aa85461d2936. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:14:41.966450 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for user 31f3271adc36406fb303fb169020e740 and project 5b86ec91335c49aaa672aa85461d2936. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:14:41.979320 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:14:41.981770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:14:42.008788 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-29bbc846-bb4d-417a-af9a-1ad9cff0273d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:42.011093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-29bbc846-bb4d-417a-af9a-1ad9cff0273d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:42.018772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29bbc846-bb4d-417a-af9a-1ad9cff0273d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:42.019295 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29bbc846-bb4d-417a-af9a-1ad9cff0273d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:42.019737 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29bbc846-bb4d-417a-af9a-1ad9cff0273d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:42.021747 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29bbc846-bb4d-417a-af9a-1ad9cff0273d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:42.022250 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29bbc846-bb4d-417a-af9a-1ad9cff0273d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:42.022687 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29bbc846-bb4d-417a-af9a-1ad9cff0273d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:42.053442 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-29bbc846-bb4d-417a-af9a-1ad9cff0273d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049170 Sep 14 12:14:42.054116 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 434/864] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:14:42 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 12:14:42.125035 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7f4bc54f-7b9d-446b-b9e8-d56b29f266c9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:42.125607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7f4bc54f-7b9d-446b-b9e8-d56b29f266c9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:42.131694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f4bc54f-7b9d-446b-b9e8-d56b29f266c9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:42.132180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f4bc54f-7b9d-446b-b9e8-d56b29f266c9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:42.132616 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f4bc54f-7b9d-446b-b9e8-d56b29f266c9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:42.133328 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f4bc54f-7b9d-446b-b9e8-d56b29f266c9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:42.133783 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f4bc54f-7b9d-446b-b9e8-d56b29f266c9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:42.134250 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7f4bc54f-7b9d-446b-b9e8-d56b29f266c9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:42.162830 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7f4bc54f-7b9d-446b-b9e8-d56b29f266c9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Going to try to terminate instance {{(pid=121152) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:14:42.207920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-77507935-c098-42eb-9ef6-7d303ae6013d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.778211 Sep 14 12:14:42.208521 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 431/865] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:14:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:14:42.220785 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a6d6ccb1-0c97-43e9-bb37-efdba9650a35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:42.221395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a6d6ccb1-0c97-43e9-bb37-efdba9650a35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:42.279915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a6d6ccb1-0c97-43e9-bb37-efdba9650a35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:42.286877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a6d6ccb1-0c97-43e9-bb37-efdba9650a35 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1241 microversion: 2.1 time: 0.070531 Sep 14 12:14:42.287459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 432/866] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:42 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:42.638091 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7f4bc54f-7b9d-446b-b9e8-d56b29f266c9 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "DELETE /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 204 len: 0 microversion: 2.1 time: 0.516722 Sep 14 12:14:42.639316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 435/867] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:14:42 2022] DELETE /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 12:14:42.647532 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1ea746da-3fb5-4f0b-8c87-54ee5aceaa1b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:42.652096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1ea746da-3fb5-4f0b-8c87-54ee5aceaa1b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:42.657116 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ea746da-3fb5-4f0b-8c87-54ee5aceaa1b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:42.657611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ea746da-3fb5-4f0b-8c87-54ee5aceaa1b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:42.658082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ea746da-3fb5-4f0b-8c87-54ee5aceaa1b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:42.658783 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ea746da-3fb5-4f0b-8c87-54ee5aceaa1b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:42.659242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ea746da-3fb5-4f0b-8c87-54ee5aceaa1b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:42.659681 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ea746da-3fb5-4f0b-8c87-54ee5aceaa1b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:42.956031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1ea746da-3fb5-4f0b-8c87-54ee5aceaa1b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:42.965813 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1ea746da-3fb5-4f0b-8c87-54ee5aceaa1b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1674 microversion: 2.1 time: 0.322032 Sep 14 12:14:42.966453 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 433/868] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:42 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1674 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:43.310711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e132ebff-9988-4e6f-aa62-c4b1005826c1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:43.311417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e132ebff-9988-4e6f-aa62-c4b1005826c1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:43.313770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 12:14:43.313950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Wed Sep 14 12:14:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df (ip 10.222.0.62) !!! Sep 14 12:14:43.321181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e132ebff-9988-4e6f-aa62-c4b1005826c1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:43.321673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e132ebff-9988-4e6f-aa62-c4b1005826c1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:43.322151 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e132ebff-9988-4e6f-aa62-c4b1005826c1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:43.322848 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e132ebff-9988-4e6f-aa62-c4b1005826c1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:43.323308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e132ebff-9988-4e6f-aa62-c4b1005826c1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:43.323735 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e132ebff-9988-4e6f-aa62-c4b1005826c1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:43.389142 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e132ebff-9988-4e6f-aa62-c4b1005826c1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:43.391488 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:43.397632 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e132ebff-9988-4e6f-aa62-c4b1005826c1 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1245 microversion: 2.1 time: 0.091357 Sep 14 12:14:43.398246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 436/869] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:43 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:43.989098 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fcbc5698-fb07-48af-a6d1-a4c619fa7185 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:43.989742 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fcbc5698-fb07-48af-a6d1-a4c619fa7185 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:43.996234 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcbc5698-fb07-48af-a6d1-a4c619fa7185 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:43.996720 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcbc5698-fb07-48af-a6d1-a4c619fa7185 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:43.997153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcbc5698-fb07-48af-a6d1-a4c619fa7185 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:43.997849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcbc5698-fb07-48af-a6d1-a4c619fa7185 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:43.998319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcbc5698-fb07-48af-a6d1-a4c619fa7185 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:43.999227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fcbc5698-fb07-48af-a6d1-a4c619fa7185 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:44.132836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fcbc5698-fb07-48af-a6d1-a4c619fa7185 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:44.141281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fcbc5698-fb07-48af-a6d1-a4c619fa7185 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1674 microversion: 2.1 time: 0.155697 Sep 14 12:14:44.141841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 434/870] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:43 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:44.422540 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-663db617-9ba1-4dda-b82b-630dbad82381 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:44.423162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-663db617-9ba1-4dda-b82b-630dbad82381 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:44.430508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-663db617-9ba1-4dda-b82b-630dbad82381 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:44.431005 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-663db617-9ba1-4dda-b82b-630dbad82381 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:44.431449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-663db617-9ba1-4dda-b82b-630dbad82381 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:44.432221 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-663db617-9ba1-4dda-b82b-630dbad82381 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:44.432643 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-663db617-9ba1-4dda-b82b-630dbad82381 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:44.433071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-663db617-9ba1-4dda-b82b-630dbad82381 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:44.523254 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-663db617-9ba1-4dda-b82b-630dbad82381 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:44.531972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-663db617-9ba1-4dda-b82b-630dbad82381 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1293 microversion: 2.1 time: 0.114271 Sep 14 12:14:44.532559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 437/871] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:44 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:44.743289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bb7502dd-b754-439b-b584-7fc9bb2a98aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:44.743904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bb7502dd-b754-439b-b584-7fc9bb2a98aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:44.749714 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bb7502dd-b754-439b-b584-7fc9bb2a98aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:44.750241 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bb7502dd-b754-439b-b584-7fc9bb2a98aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:44.750682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bb7502dd-b754-439b-b584-7fc9bb2a98aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:44.751377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bb7502dd-b754-439b-b584-7fc9bb2a98aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:44.752451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bb7502dd-b754-439b-b584-7fc9bb2a98aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:44.752870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bb7502dd-b754-439b-b584-7fc9bb2a98aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:44.838058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-bb7502dd-b754-439b-b584-7fc9bb2a98aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lazy-loading 'services' on Instance uuid bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:14:45.096208 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bb7502dd-b754-439b-b584-7fc9bb2a98aa tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments/250ebf0b-7e63-4d27-81e2-335622d0de93" status: 202 len: 0 microversion: 2.1 time: 0.356974 Sep 14 12:14:45.096907 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 435/872] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:14:44 2022] DELETE /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments/250ebf0b-7e63-4d27-81e2-335622d0de93 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:14:45.105250 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7e122c88-57f8-4a04-98f6-baa11b746661 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:45.107793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7e122c88-57f8-4a04-98f6-baa11b746661 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:45.114913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e122c88-57f8-4a04-98f6-baa11b746661 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:45.115406 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e122c88-57f8-4a04-98f6-baa11b746661 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:45.115848 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e122c88-57f8-4a04-98f6-baa11b746661 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:45.116556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e122c88-57f8-4a04-98f6-baa11b746661 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:45.117151 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e122c88-57f8-4a04-98f6-baa11b746661 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:45.117512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e122c88-57f8-4a04-98f6-baa11b746661 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:45.148955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7e122c88-57f8-4a04-98f6-baa11b746661 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047663 Sep 14 12:14:45.149798 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 438/873] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:14:45 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:45.165095 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c5636e5c-1783-4990-9156-16bc72774e85 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:45.165803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c5636e5c-1783-4990-9156-16bc72774e85 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:45.188063 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5636e5c-1783-4990-9156-16bc72774e85 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:45.188568 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5636e5c-1783-4990-9156-16bc72774e85 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:45.189013 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5636e5c-1783-4990-9156-16bc72774e85 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:45.190138 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5636e5c-1783-4990-9156-16bc72774e85 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:45.190629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5636e5c-1783-4990-9156-16bc72774e85 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:45.192160 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c5636e5c-1783-4990-9156-16bc72774e85 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:45.294452 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c5636e5c-1783-4990-9156-16bc72774e85 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:45.303290 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c5636e5c-1783-4990-9156-16bc72774e85 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1606 microversion: 2.1 time: 0.142401 Sep 14 12:14:45.307511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 436/874] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:45 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1606 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:45.559629 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-6a5b8698-2be2-4596-a33f-14c4694621e5 req-47f545c6-2067-4114-ba8c-342ec8cd36fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ce41d2-7079-429c-a18a-de51b2c20e6b", "name": "network-vif-deleted", "tag": "07ecea17-6958-4771-b1ae-f0ad902c21eb"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:45.561109 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cffac50b-41c8-4486-b39a-81af53aa9ee0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:45.561817 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cffac50b-41c8-4486-b39a-81af53aa9ee0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:45.570580 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cffac50b-41c8-4486-b39a-81af53aa9ee0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:45.571302 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cffac50b-41c8-4486-b39a-81af53aa9ee0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:45.571817 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cffac50b-41c8-4486-b39a-81af53aa9ee0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:45.572606 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cffac50b-41c8-4486-b39a-81af53aa9ee0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:45.573138 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cffac50b-41c8-4486-b39a-81af53aa9ee0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:45.573637 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cffac50b-41c8-4486-b39a-81af53aa9ee0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:45.575451 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6a5b8698-2be2-4596-a33f-14c4694621e5 req-47f545c6-2067-4114-ba8c-342ec8cd36fb service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:45.576139 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6a5b8698-2be2-4596-a33f-14c4694621e5 req-47f545c6-2067-4114-ba8c-342ec8cd36fb service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:45.579697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6a5b8698-2be2-4596-a33f-14c4694621e5 req-47f545c6-2067-4114-ba8c-342ec8cd36fb service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:45.595062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-6a5b8698-2be2-4596-a33f-14c4694621e5 req-47f545c6-2067-4114-ba8c-342ec8cd36fb service nova] Creating event network-vif-deleted:07ecea17-6958-4771-b1ae-f0ad902c21eb for instance 76ce41d2-7079-429c-a18a-de51b2c20e6b on hv-cinder-84496 Sep 14 12:14:45.601138 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-6a5b8698-2be2-4596-a33f-14c4694621e5 req-47f545c6-2067-4114-ba8c-342ec8cd36fb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045807 Sep 14 12:14:45.602429 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 439/875] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:45.644314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cffac50b-41c8-4486-b39a-81af53aa9ee0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:45.648459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:45.653717 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cffac50b-41c8-4486-b39a-81af53aa9ee0 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1301 microversion: 2.1 time: 0.097065 Sep 14 12:14:45.654437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 437/876] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:45 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:46.164678 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-38295112-4597-47c6-b3e5-cc800a55a93a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:46.167767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-38295112-4597-47c6-b3e5-cc800a55a93a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:46.176402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38295112-4597-47c6-b3e5-cc800a55a93a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:46.177333 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38295112-4597-47c6-b3e5-cc800a55a93a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:46.178058 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38295112-4597-47c6-b3e5-cc800a55a93a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:46.179267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38295112-4597-47c6-b3e5-cc800a55a93a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:46.179962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38295112-4597-47c6-b3e5-cc800a55a93a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:46.180622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-38295112-4597-47c6-b3e5-cc800a55a93a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:46.235159 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-38295112-4597-47c6-b3e5-cc800a55a93a tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075613 Sep 14 12:14:46.236431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 440/877] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:14:46 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:46.335616 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:46.335616 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:46.339150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:46.340039 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:46.340491 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:46.341230 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:46.341683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:46.342142 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:46.403446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:46.403940 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:46.404575 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:46.405743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lazy-loading 'fault' on Instance uuid 76ce41d2-7079-429c-a18a-de51b2c20e6b {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:14:46.458448 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:46.479046 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9be0a7cd-f17a-40b5-8c7d-5f8ea059b3a2 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 200 len: 1327 microversion: 2.1 time: 0.154394 Sep 14 12:14:46.494886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 438/878] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:46 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 1327 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:46.678094 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-aa144a98-e4ba-4a17-a614-da22a403fcc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:46.678783 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-aa144a98-e4ba-4a17-a614-da22a403fcc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:46.685875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa144a98-e4ba-4a17-a614-da22a403fcc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:46.686276 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa144a98-e4ba-4a17-a614-da22a403fcc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:46.686905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa144a98-e4ba-4a17-a614-da22a403fcc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:46.688179 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa144a98-e4ba-4a17-a614-da22a403fcc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:46.689138 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa144a98-e4ba-4a17-a614-da22a403fcc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:46.689591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa144a98-e4ba-4a17-a614-da22a403fcc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:46.859445 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-aa144a98-e4ba-4a17-a614-da22a403fcc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:46.871469 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-aa144a98-e4ba-4a17-a614-da22a403fcc6 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.194841 Sep 14 12:14:46.871469 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 441/879] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:46 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:47.248311 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e6f9d4e5-b690-4ae7-8109-9a141c45b2a5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:47.251205 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e6f9d4e5-b690-4ae7-8109-9a141c45b2a5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:47.258147 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6f9d4e5-b690-4ae7-8109-9a141c45b2a5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.258644 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6f9d4e5-b690-4ae7-8109-9a141c45b2a5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.259082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6f9d4e5-b690-4ae7-8109-9a141c45b2a5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.259788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6f9d4e5-b690-4ae7-8109-9a141c45b2a5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.260359 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6f9d4e5-b690-4ae7-8109-9a141c45b2a5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.260788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6f9d4e5-b690-4ae7-8109-9a141c45b2a5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.293253 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e6f9d4e5-b690-4ae7-8109-9a141c45b2a5 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048285 Sep 14 12:14:47.294092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 439/880] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:14:47 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 12:14:47.370157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-acedd0b9-6da5-4161-9ec2-ffc0a14582e6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:47.370716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-acedd0b9-6da5-4161-9ec2-ffc0a14582e6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:47.379125 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-acedd0b9-6da5-4161-9ec2-ffc0a14582e6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.379540 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-acedd0b9-6da5-4161-9ec2-ffc0a14582e6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.380249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-acedd0b9-6da5-4161-9ec2-ffc0a14582e6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.381223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-acedd0b9-6da5-4161-9ec2-ffc0a14582e6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.381683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-acedd0b9-6da5-4161-9ec2-ffc0a14582e6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.382363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-acedd0b9-6da5-4161-9ec2-ffc0a14582e6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.410698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-acedd0b9-6da5-4161-9ec2-ffc0a14582e6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Going to try to terminate instance {{(pid=121152) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:14:47.504171 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:47.504816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:47.511045 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.511743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.512351 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.513070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.513531 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.513984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.528443 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] HTTP exception thrown: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Request method failure captured: Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b HTTP/1.1 Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcO0Irlx0GI5viiJ5gPPLZGZ3QR43QeUDcz6ynKAS749BzWiJT_HrB0lZgF_uTZ_WaQi1-pF7ByTzGqYR0biRVT5Qw7OrUyzndtcagnFaplH1_P412mOI-mKbAF5eRuisbB46BFEhJNwC1z2NuntWmXkT01GbqjYq8vQPQO3S4dc3BU Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:14:47.530671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}] Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 2ba1860ce5504c27816a504776463d9c Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:14:47.537683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '76ce41d2-7079-429c-a18a-de51b2c20e6b'} Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:14:47.538587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:14:47.539990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:14:47.541381 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Returning 404 to user: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:14:47.541381 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6d276bbe-e9c4-4721-9776-95aac82ccf1d tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 404 len: 111 microversion: 2.1 time: 0.033296 Sep 14 12:14:47.541381 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 440/881] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:47 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:14:47.542786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-317d52af-b39e-4420-8f66-ace95a5fbcbc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '.version_select at 0x7f1c99d16af0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:47.655282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-317d52af-b39e-4420-8f66-ace95a5fbcbc tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-617850249" status: 202 len: 0 microversion: 2.1 time: 0.112975 Sep 14 12:14:47.655282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 441/882] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 14 12:14:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-617850249 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:14:47.727843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-a7735792-c3bf-432f-aea1-3d626dd011ea req-2ea189cf-0b33-4064-8cec-7e110b904592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6bf2654-f27a-4ec4-9dba-d70e557034df", "tag": "2f4cdaf2-f722-4368-bdce-05dda4448873"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:47.740160 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-a7735792-c3bf-432f-aea1-3d626dd011ea req-2ea189cf-0b33-4064-8cec-7e110b904592 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.740652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-a7735792-c3bf-432f-aea1-3d626dd011ea req-2ea189cf-0b33-4064-8cec-7e110b904592 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.741085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-a7735792-c3bf-432f-aea1-3d626dd011ea req-2ea189cf-0b33-4064-8cec-7e110b904592 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.748405 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-acedd0b9-6da5-4161-9ec2-ffc0a14582e6 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 204 len: 0 microversion: 2.1 time: 0.382449 Sep 14 12:14:47.752575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 442/883] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:14:47 2022] DELETE /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:14:47.758218 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-17ec9a1b-940c-4194-9b52-3650fd8247db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:47.760084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-17ec9a1b-940c-4194-9b52-3650fd8247db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:47.769741 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-a7735792-c3bf-432f-aea1-3d626dd011ea req-2ea189cf-0b33-4064-8cec-7e110b904592 service nova] Creating event network-changed:2f4cdaf2-f722-4368-bdce-05dda4448873 for instance a6bf2654-f27a-4ec4-9dba-d70e557034df on hv-cinder-84496 Sep 14 12:14:47.772794 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17ec9a1b-940c-4194-9b52-3650fd8247db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.773284 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17ec9a1b-940c-4194-9b52-3650fd8247db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.773922 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17ec9a1b-940c-4194-9b52-3650fd8247db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.775168 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17ec9a1b-940c-4194-9b52-3650fd8247db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.776465 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17ec9a1b-940c-4194-9b52-3650fd8247db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.777059 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17ec9a1b-940c-4194-9b52-3650fd8247db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.777485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-a7735792-c3bf-432f-aea1-3d626dd011ea req-2ea189cf-0b33-4064-8cec-7e110b904592 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055694 Sep 14 12:14:47.778363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 442/884] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:14:47.895194 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5372caa4-b90f-4ec7-80e6-987f580127ef tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:47.896443 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5372caa4-b90f-4ec7-80e6-987f580127ef tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:47.910390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5372caa4-b90f-4ec7-80e6-987f580127ef tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.911376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5372caa4-b90f-4ec7-80e6-987f580127ef tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.912163 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5372caa4-b90f-4ec7-80e6-987f580127ef tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.913402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5372caa4-b90f-4ec7-80e6-987f580127ef tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:47.914467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5372caa4-b90f-4ec7-80e6-987f580127ef tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:47.915229 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5372caa4-b90f-4ec7-80e6-987f580127ef tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:47.940789 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-17ec9a1b-940c-4194-9b52-3650fd8247db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:47.954187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-17ec9a1b-940c-4194-9b52-3650fd8247db tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1687 microversion: 2.1 time: 0.200269 Sep 14 12:14:47.954776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 443/885] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:47 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:48.084104 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5372caa4-b90f-4ec7-80e6-987f580127ef tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:48.092894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5372caa4-b90f-4ec7-80e6-987f580127ef tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.203587 Sep 14 12:14:48.093559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 443/886] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:47 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:48.483022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a8c588e9-46df-481b-9f7a-37ba62e764db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'create', calling method: .version_select at 0x7f1c99b865e0>, body: {"keypair": {"name": "tempest-keypair-428259511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOQionmUy5u4uEK16CO9gInGJlyVUd28AUWUXaj7Z7HF9v05PL04dOJNApScDVHbNQK8+xsaVvOMbjiqhmi6lKqWapcRyz3p3fWZIG/K6LqbsMTfbFtXZvh93tHkowKIg=="}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:48.488365 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=4 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:48.500034 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-a8c588e9-46df-481b-9f7a-37ba62e764db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Getting quotas for project e35c2ab9a9644cadadd4da9a544b944b. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:14:48.503867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-a8c588e9-46df-481b-9f7a-37ba62e764db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Getting quotas for user 2ba1860ce5504c27816a504776463d9c and project e35c2ab9a9644cadadd4da9a544b944b. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:14:48.589525 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a8c588e9-46df-481b-9f7a-37ba62e764db tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110449 Sep 14 12:14:48.590170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 444/887] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 14 12:14:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:48.980999 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e3e4ae96-b6a6-4988-bded-0fea191f3642 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:48.981684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e3e4ae96-b6a6-4988-bded-0fea191f3642 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:48.989048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3e4ae96-b6a6-4988-bded-0fea191f3642 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:48.989545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3e4ae96-b6a6-4988-bded-0fea191f3642 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:48.990020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3e4ae96-b6a6-4988-bded-0fea191f3642 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:48.990726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3e4ae96-b6a6-4988-bded-0fea191f3642 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:48.991187 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3e4ae96-b6a6-4988-bded-0fea191f3642 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:48.991643 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e3e4ae96-b6a6-4988-bded-0fea191f3642 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:49.117896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-eaf6dbe4-19bb-4499-9d51-72d4f8730866 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:49.119169 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-eaf6dbe4-19bb-4499-9d51-72d4f8730866 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:49.124802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e3e4ae96-b6a6-4988-bded-0fea191f3642 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:49.126511 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eaf6dbe4-19bb-4499-9d51-72d4f8730866 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:49.127195 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eaf6dbe4-19bb-4499-9d51-72d4f8730866 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:49.128089 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eaf6dbe4-19bb-4499-9d51-72d4f8730866 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:49.128852 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eaf6dbe4-19bb-4499-9d51-72d4f8730866 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:49.129308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eaf6dbe4-19bb-4499-9d51-72d4f8730866 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:49.129734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eaf6dbe4-19bb-4499-9d51-72d4f8730866 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:49.133726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e3e4ae96-b6a6-4988-bded-0fea191f3642 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1687 microversion: 2.1 time: 0.157307 Sep 14 12:14:49.134326 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 444/888] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:48 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:49.506152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-eaf6dbe4-19bb-4499-9d51-72d4f8730866 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:49.513914 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-eaf6dbe4-19bb-4499-9d51-72d4f8730866 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.401629 Sep 14 12:14:49.514539 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 445/889] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:49 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:50.157073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dff2cd9e-b940-4c1d-afad-107ca3871d68 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:50.157792 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dff2cd9e-b940-4c1d-afad-107ca3871d68 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:50.164245 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dff2cd9e-b940-4c1d-afad-107ca3871d68 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:50.165246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dff2cd9e-b940-4c1d-afad-107ca3871d68 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:50.165246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dff2cd9e-b940-4c1d-afad-107ca3871d68 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:50.166053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dff2cd9e-b940-4c1d-afad-107ca3871d68 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:50.166589 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dff2cd9e-b940-4c1d-afad-107ca3871d68 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:50.167021 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dff2cd9e-b940-4c1d-afad-107ca3871d68 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:50.300153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dff2cd9e-b940-4c1d-afad-107ca3871d68 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:50.308679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dff2cd9e-b940-4c1d-afad-107ca3871d68 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1687 microversion: 2.1 time: 0.156102 Sep 14 12:14:50.309256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 445/890] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:50 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:50.539437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-579435e3-7166-4d0c-9b7b-1fc7ce117c46 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:50.540161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-579435e3-7166-4d0c-9b7b-1fc7ce117c46 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:50.546920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-579435e3-7166-4d0c-9b7b-1fc7ce117c46 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:50.547413 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-579435e3-7166-4d0c-9b7b-1fc7ce117c46 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:50.548074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-579435e3-7166-4d0c-9b7b-1fc7ce117c46 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:50.548769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-579435e3-7166-4d0c-9b7b-1fc7ce117c46 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:50.549224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-579435e3-7166-4d0c-9b7b-1fc7ce117c46 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:50.549657 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-579435e3-7166-4d0c-9b7b-1fc7ce117c46 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:50.727215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-579435e3-7166-4d0c-9b7b-1fc7ce117c46 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:50.734954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-579435e3-7166-4d0c-9b7b-1fc7ce117c46 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.199400 Sep 14 12:14:50.735537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 446/891] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:50 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:51.075575 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1545949067", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f06a80ac-04e5-4ae1-9b24-c817b700ac9e"}], "security_groups": [{"name": "tempest-securitygroup--342342792"}], "key_name": "tempest-keypair-428259511", "user_data": "}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:51.268791 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] validate_networks() for [('f06a80ac-04e5-4ae1-9b24-c817b700ac9e', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:14:51.331818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-324bf8b8-975a-46f3-8da6-1369788af19b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:51.332464 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-324bf8b8-975a-46f3-8da6-1369788af19b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:51.338218 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-324bf8b8-975a-46f3-8da6-1369788af19b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:51.338714 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-324bf8b8-975a-46f3-8da6-1369788af19b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:51.339151 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-324bf8b8-975a-46f3-8da6-1369788af19b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:51.339837 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-324bf8b8-975a-46f3-8da6-1369788af19b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:51.340292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-324bf8b8-975a-46f3-8da6-1369788af19b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:51.340711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-324bf8b8-975a-46f3-8da6-1369788af19b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:51.741378 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-324bf8b8-975a-46f3-8da6-1369788af19b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:51.749619 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-324bf8b8-975a-46f3-8da6-1369788af19b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1687 microversion: 2.1 time: 0.421706 Sep 14 12:14:51.750581 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 447/892] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:51 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1687 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:51.759791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d962da69-86f9-4a46-9693-1b0baa62c40c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:51.761193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d962da69-86f9-4a46-9693-1b0baa62c40c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:51.770610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d962da69-86f9-4a46-9693-1b0baa62c40c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:51.771186 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d962da69-86f9-4a46-9693-1b0baa62c40c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:51.771689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d962da69-86f9-4a46-9693-1b0baa62c40c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:51.772508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d962da69-86f9-4a46-9693-1b0baa62c40c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:51.773031 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d962da69-86f9-4a46-9693-1b0baa62c40c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:51.773515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d962da69-86f9-4a46-9693-1b0baa62c40c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:51.899616 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:51.953622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:52.121468 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d962da69-86f9-4a46-9693-1b0baa62c40c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:52.130151 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d962da69-86f9-4a46-9693-1b0baa62c40c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.374331 Sep 14 12:14:52.146102 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 448/893] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:51 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:52.275251 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:14:52.275834 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:14:52.279122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:14:52.279122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:14:52.279122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:14:52.286675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:52.287163 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:52.287805 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:52.288660 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:52.289121 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:52.289577 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:52.306854 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Getting quotas for project e35c2ab9a9644cadadd4da9a544b944b. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:14:52.310759 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Getting quotas for user 2ba1860ce5504c27816a504776463d9c and project e35c2ab9a9644cadadd4da9a544b944b. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:14:52.322415 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:14:52.324695 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:14:52.494846 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b5775837-391e-4963-b92a-bff62fa52d32 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.423554 Sep 14 12:14:52.495508 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 446/894] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:14:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:14:52.508300 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6c2914cc-e6e2-447d-b48c-9c8c4756afff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:52.508928 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6c2914cc-e6e2-447d-b48c-9c8c4756afff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:52.511229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:52.597034 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6c2914cc-e6e2-447d-b48c-9c8c4756afff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:52.604314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6c2914cc-e6e2-447d-b48c-9c8c4756afff tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1237 microversion: 2.1 time: 0.100383 Sep 14 12:14:52.605294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 449/895] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:52 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:52.731287 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-6b2fb4c3-4f42-44dc-a904-c1b54fd462e3 req-7683d448-8fb6-4f98-a013-4be1702c4c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1", "name": "network-vif-deleted", "tag": "027c61fc-efa6-4219-96b2-fd9ae33eb05c"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:52.743808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6b2fb4c3-4f42-44dc-a904-c1b54fd462e3 req-7683d448-8fb6-4f98-a013-4be1702c4c7b service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:52.744582 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6b2fb4c3-4f42-44dc-a904-c1b54fd462e3 req-7683d448-8fb6-4f98-a013-4be1702c4c7b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:52.745253 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-6b2fb4c3-4f42-44dc-a904-c1b54fd462e3 req-7683d448-8fb6-4f98-a013-4be1702c4c7b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:52.759432 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-6b2fb4c3-4f42-44dc-a904-c1b54fd462e3 req-7683d448-8fb6-4f98-a013-4be1702c4c7b service nova] Creating event network-vif-deleted:027c61fc-efa6-4219-96b2-fd9ae33eb05c for instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 on hv-cinder-84496 Sep 14 12:14:52.764965 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-6b2fb4c3-4f42-44dc-a904-c1b54fd462e3 req-7683d448-8fb6-4f98-a013-4be1702c4c7b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037419 Sep 14 12:14:52.765626 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 447/896] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:52.776881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2d97f370-d563-4a0e-bc8e-be9d88ee4476 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:52.777507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2d97f370-d563-4a0e-bc8e-be9d88ee4476 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:52.785481 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d97f370-d563-4a0e-bc8e-be9d88ee4476 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:52.789153 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d97f370-d563-4a0e-bc8e-be9d88ee4476 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:52.789792 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d97f370-d563-4a0e-bc8e-be9d88ee4476 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:52.790746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d97f370-d563-4a0e-bc8e-be9d88ee4476 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:52.791430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d97f370-d563-4a0e-bc8e-be9d88ee4476 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:52.792035 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d97f370-d563-4a0e-bc8e-be9d88ee4476 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:52.869760 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d97f370-d563-4a0e-bc8e-be9d88ee4476 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:52.881069 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2d97f370-d563-4a0e-bc8e-be9d88ee4476 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1620 microversion: 2.1 time: 0.108757 Sep 14 12:14:52.898120 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 450/897] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:52 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1620 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:53.154286 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2abf27d6-1458-470a-a920-c4a25b7b17df tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:53.155035 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2abf27d6-1458-470a-a920-c4a25b7b17df tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:53.161309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2abf27d6-1458-470a-a920-c4a25b7b17df tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:53.161809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2abf27d6-1458-470a-a920-c4a25b7b17df tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:53.162278 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2abf27d6-1458-470a-a920-c4a25b7b17df tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:53.162984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2abf27d6-1458-470a-a920-c4a25b7b17df tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:53.163622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2abf27d6-1458-470a-a920-c4a25b7b17df tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:53.164047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2abf27d6-1458-470a-a920-c4a25b7b17df tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:53.308183 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2abf27d6-1458-470a-a920-c4a25b7b17df tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:53.317148 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2abf27d6-1458-470a-a920-c4a25b7b17df tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.167082 Sep 14 12:14:53.317718 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 448/898] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:53 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:53.629079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-003599f4-5071-4eab-af08-66101767bd3c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:53.629687 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-003599f4-5071-4eab-af08-66101767bd3c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:53.636405 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-003599f4-5071-4eab-af08-66101767bd3c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:53.636895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-003599f4-5071-4eab-af08-66101767bd3c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:53.637332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-003599f4-5071-4eab-af08-66101767bd3c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:53.638058 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-003599f4-5071-4eab-af08-66101767bd3c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:53.638516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-003599f4-5071-4eab-af08-66101767bd3c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:53.638944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-003599f4-5071-4eab-af08-66101767bd3c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:53.701188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-003599f4-5071-4eab-af08-66101767bd3c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:53.709841 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-003599f4-5071-4eab-af08-66101767bd3c tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1241 microversion: 2.1 time: 0.085051 Sep 14 12:14:53.710439 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 451/899] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:53 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:53.905622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4a33f498-5255-4522-9c3e-2d5e1756b123 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:53.906314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4a33f498-5255-4522-9c3e-2d5e1756b123 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:53.912908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a33f498-5255-4522-9c3e-2d5e1756b123 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:53.913401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a33f498-5255-4522-9c3e-2d5e1756b123 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:53.913843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a33f498-5255-4522-9c3e-2d5e1756b123 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:53.914566 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a33f498-5255-4522-9c3e-2d5e1756b123 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:53.915022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a33f498-5255-4522-9c3e-2d5e1756b123 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:53.915450 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4a33f498-5255-4522-9c3e-2d5e1756b123 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:53.978201 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4a33f498-5255-4522-9c3e-2d5e1756b123 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:53.986235 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4a33f498-5255-4522-9c3e-2d5e1756b123 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1620 microversion: 2.1 time: 0.085220 Sep 14 12:14:53.986823 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 449/900] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:53 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1620 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:54.340394 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0d710bf7-0e23-46e3-af95-536a450861a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:54.341003 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0d710bf7-0e23-46e3-af95-536a450861a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:54.347056 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d710bf7-0e23-46e3-af95-536a450861a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:54.347685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d710bf7-0e23-46e3-af95-536a450861a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:54.348124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d710bf7-0e23-46e3-af95-536a450861a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:54.348808 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d710bf7-0e23-46e3-af95-536a450861a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:54.349260 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d710bf7-0e23-46e3-af95-536a450861a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:54.349699 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d710bf7-0e23-46e3-af95-536a450861a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:54.494755 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0d710bf7-0e23-46e3-af95-536a450861a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:54.503117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0d710bf7-0e23-46e3-af95-536a450861a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.166618 Sep 14 12:14:54.503692 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 452/901] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:54 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:54.732618 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-562e190a-9bdc-49b8-9bcf-ef1394e6d19a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:54.733801 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-562e190a-9bdc-49b8-9bcf-ef1394e6d19a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:54.739868 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-562e190a-9bdc-49b8-9bcf-ef1394e6d19a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:54.740361 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-562e190a-9bdc-49b8-9bcf-ef1394e6d19a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:54.740985 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-562e190a-9bdc-49b8-9bcf-ef1394e6d19a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:54.741713 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-562e190a-9bdc-49b8-9bcf-ef1394e6d19a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:54.742231 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-562e190a-9bdc-49b8-9bcf-ef1394e6d19a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:54.742662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-562e190a-9bdc-49b8-9bcf-ef1394e6d19a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:54.804337 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-562e190a-9bdc-49b8-9bcf-ef1394e6d19a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:54.812813 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-562e190a-9bdc-49b8-9bcf-ef1394e6d19a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1233 microversion: 2.1 time: 0.084155 Sep 14 12:14:54.813381 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 450/902] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:54 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:55.009388 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:55.009954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:55.016373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:55.016862 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:55.017303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:55.018040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:55.018539 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:55.018991 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:55.051237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:55.051726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:55.052164 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:55.052619 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lazy-loading 'fault' on Instance uuid bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:14:55.092556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:55.100532 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4af56171-b894-4f14-b104-58a49da347bd tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 200 len: 1335 microversion: 2.1 time: 0.095107 Sep 14 12:14:55.111188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 453/903] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:55 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:55.527627 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f8c5e391-d242-4c56-bd21-2b43ec537925 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:55.528242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f8c5e391-d242-4c56-bd21-2b43ec537925 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:55.534816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8c5e391-d242-4c56-bd21-2b43ec537925 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:55.535732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8c5e391-d242-4c56-bd21-2b43ec537925 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:55.536484 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8c5e391-d242-4c56-bd21-2b43ec537925 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:55.537194 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8c5e391-d242-4c56-bd21-2b43ec537925 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:55.537646 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8c5e391-d242-4c56-bd21-2b43ec537925 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:55.538105 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8c5e391-d242-4c56-bd21-2b43ec537925 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:55.676855 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f8c5e391-d242-4c56-bd21-2b43ec537925 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:55.684744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f8c5e391-d242-4c56-bd21-2b43ec537925 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.161163 Sep 14 12:14:55.685314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 451/904] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:55 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:55.836686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2ddcd2b0-0222-45a3-8d9f-2259d3e8309f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:55.837320 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2ddcd2b0-0222-45a3-8d9f-2259d3e8309f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:55.843772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ddcd2b0-0222-45a3-8d9f-2259d3e8309f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:55.849550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ddcd2b0-0222-45a3-8d9f-2259d3e8309f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:55.849550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ddcd2b0-0222-45a3-8d9f-2259d3e8309f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:55.849550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ddcd2b0-0222-45a3-8d9f-2259d3e8309f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:55.849550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ddcd2b0-0222-45a3-8d9f-2259d3e8309f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:55.849989 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ddcd2b0-0222-45a3-8d9f-2259d3e8309f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:55.849989 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:55.909521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2ddcd2b0-0222-45a3-8d9f-2259d3e8309f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:55.917637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2ddcd2b0-0222-45a3-8d9f-2259d3e8309f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1289 microversion: 2.1 time: 0.084965 Sep 14 12:14:55.918252 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 454/905] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:55 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:56.123840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:56.124453 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:56.130469 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:56.130954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:56.131391 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:56.132100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:56.132543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:56.132968 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:56.146810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] HTTP exception thrown: Instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 could not be found. Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Request method failure captured: Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 HTTP/1.1 Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcO0QaCS6xXTzM6jpZKpig5OWwgN4DxcmFTi61vISCiYbIqj92GCFK2Ykao8lOPtpzCjwB5UFh2EALT9e-6aRP6sfCRAMRClNQTuYs6OK-1skVV-bbMgM1Rb_IgbUayTgQvhQjd_qmnAYRMCxoLQ6qRy3J7d-3d9WDsecW3_-xRcxwM Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 748b7c08460b4f718dfff67275d8e4e4 Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:14:56.148486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/748b7c08460b4f718dfff67275d8e4e4"}]}] Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 748b7c08460b4f718dfff67275d8e4e4 Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-ServerRescueNegativeTestJSON-761218752-project Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 4bd4125ff6bb400bae1b94df7d2cfa17 Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-ServerRescueNegativeTestJSON-761218752-project Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 could not be found. Sep 14 12:14:56.155227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': 'bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1'} Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 could not be found. Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:14:56.156285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 could not be found. Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 could not be found. Sep 14 12:14:56.157908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:14:56.159300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Returning 404 to user: Instance bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:14:56.159300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2e7b53cc-8731-4e49-bbf6-a35da0946671 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1" status: 404 len: 111 microversion: 2.1 time: 0.030154 Sep 14 12:14:56.159300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 452/906] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:56 2022] GET /compute/v2.1/servers/bcbc2dd8-bf72-499b-b5cc-7d0a3f622ed1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:14:56.160002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7b010f1f-804c-49ad-b742-29b561c0eb62 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '.version_select at 0x7f1c99b0b430>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:56.275493 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7b010f1f-804c-49ad-b742-29b561c0eb62 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508153332" status: 202 len: 0 microversion: 2.1 time: 0.119763 Sep 14 12:14:56.276086 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 455/907] 10.222.0.62 () {58 vars in 1221 bytes} [Wed Sep 14 12:14:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508153332 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:14:56.708656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-87e88171-5b24-4022-81d1-b4233d1f0863 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:56.709302 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-87e88171-5b24-4022-81d1-b4233d1f0863 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:56.715818 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87e88171-5b24-4022-81d1-b4233d1f0863 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:56.716310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87e88171-5b24-4022-81d1-b4233d1f0863 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:56.716755 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87e88171-5b24-4022-81d1-b4233d1f0863 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:56.717493 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87e88171-5b24-4022-81d1-b4233d1f0863 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:56.718281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87e88171-5b24-4022-81d1-b4233d1f0863 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:56.718716 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-87e88171-5b24-4022-81d1-b4233d1f0863 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:56.942019 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-17bbf25b-31da-469f-96ea-96d5b2bd978e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:56.942676 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-17bbf25b-31da-469f-96ea-96d5b2bd978e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:56.950547 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17bbf25b-31da-469f-96ea-96d5b2bd978e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:56.951043 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17bbf25b-31da-469f-96ea-96d5b2bd978e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:56.951967 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17bbf25b-31da-469f-96ea-96d5b2bd978e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:56.952161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17bbf25b-31da-469f-96ea-96d5b2bd978e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:56.952607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17bbf25b-31da-469f-96ea-96d5b2bd978e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:56.953025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-17bbf25b-31da-469f-96ea-96d5b2bd978e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:57.208892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-17bbf25b-31da-469f-96ea-96d5b2bd978e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:57.214712 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-87e88171-5b24-4022-81d1-b4233d1f0863 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:57.217938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-17bbf25b-31da-469f-96ea-96d5b2bd978e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1295 microversion: 2.1 time: 0.279944 Sep 14 12:14:57.218669 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 456/908] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:56 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1295 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:57.226934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-87e88171-5b24-4022-81d1-b4233d1f0863 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.521962 Sep 14 12:14:57.241550 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 453/909] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:56 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:58.243590 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-09acea65-c975-40de-9c64-333e529754f3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:58.244477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-09acea65-c975-40de-9c64-333e529754f3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:58.255952 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f208599c-dc24-4ece-a0a7-a0e449959d0f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:58.256553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f208599c-dc24-4ece-a0a7-a0e449959d0f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:58.261074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-09acea65-c975-40de-9c64-333e529754f3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:58.261580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-09acea65-c975-40de-9c64-333e529754f3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:58.262072 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-09acea65-c975-40de-9c64-333e529754f3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:58.262992 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-09acea65-c975-40de-9c64-333e529754f3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:58.263448 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-09acea65-c975-40de-9c64-333e529754f3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:58.263935 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-09acea65-c975-40de-9c64-333e529754f3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:58.264649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f208599c-dc24-4ece-a0a7-a0e449959d0f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:58.265424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f208599c-dc24-4ece-a0a7-a0e449959d0f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:58.265977 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f208599c-dc24-4ece-a0a7-a0e449959d0f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:58.267253 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f208599c-dc24-4ece-a0a7-a0e449959d0f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:58.267902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f208599c-dc24-4ece-a0a7-a0e449959d0f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:58.268640 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f208599c-dc24-4ece-a0a7-a0e449959d0f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:58.521812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f208599c-dc24-4ece-a0a7-a0e449959d0f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:58.525148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-09acea65-c975-40de-9c64-333e529754f3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:58.531315 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f208599c-dc24-4ece-a0a7-a0e449959d0f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.279488 Sep 14 12:14:58.531896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 454/910] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:58 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:58.533367 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-09acea65-c975-40de-9c64-333e529754f3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1362 microversion: 2.1 time: 0.293760 Sep 14 12:14:58.533951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 457/911] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:58 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:58.560574 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-2249ff21-cd5c-4775-a306-5040899c08cb req-f236dadf-5a2d-40d3-8ad5-ee6279620fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637a4311-34dd-4f5e-b0c9-e32ec1a8a12b", "tag": "10f04e67-d152-402d-b0fd-e0db630ba32c"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:58.570810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2249ff21-cd5c-4775-a306-5040899c08cb req-f236dadf-5a2d-40d3-8ad5-ee6279620fd9 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:58.571294 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2249ff21-cd5c-4775-a306-5040899c08cb req-f236dadf-5a2d-40d3-8ad5-ee6279620fd9 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:58.571728 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-2249ff21-cd5c-4775-a306-5040899c08cb req-f236dadf-5a2d-40d3-8ad5-ee6279620fd9 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:58.584011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-2249ff21-cd5c-4775-a306-5040899c08cb req-f236dadf-5a2d-40d3-8ad5-ee6279620fd9 service nova] Creating event network-changed:10f04e67-d152-402d-b0fd-e0db630ba32c for instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b on hv-cinder-84496 Sep 14 12:14:58.589131 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-2249ff21-cd5c-4775-a306-5040899c08cb req-f236dadf-5a2d-40d3-8ad5-ee6279620fd9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033068 Sep 14 12:14:58.590202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 455/912] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:14:59.476206 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-26fa1bc7-45dc-4ca3-bd16-a6506da39377 req-d74a01f6-6736-4c66-acc2-d78f73466ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bf2654-f27a-4ec4-9dba-d70e557034df", "name": "network-vif-plugged", "status": "completed", "tag": "2f4cdaf2-f722-4368-bdce-05dda4448873"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:14:59.488510 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-26fa1bc7-45dc-4ca3-bd16-a6506da39377 req-d74a01f6-6736-4c66-acc2-d78f73466ef9 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:59.488982 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-26fa1bc7-45dc-4ca3-bd16-a6506da39377 req-d74a01f6-6736-4c66-acc2-d78f73466ef9 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:59.489411 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-26fa1bc7-45dc-4ca3-bd16-a6506da39377 req-d74a01f6-6736-4c66-acc2-d78f73466ef9 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:59.503440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-26fa1bc7-45dc-4ca3-bd16-a6506da39377 req-d74a01f6-6736-4c66-acc2-d78f73466ef9 service nova] Creating event network-vif-plugged:2f4cdaf2-f722-4368-bdce-05dda4448873 for instance a6bf2654-f27a-4ec4-9dba-d70e557034df on hv-cinder-84496 Sep 14 12:14:59.508544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-26fa1bc7-45dc-4ca3-bd16-a6506da39377 req-d74a01f6-6736-4c66-acc2-d78f73466ef9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036500 Sep 14 12:14:59.509173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 458/913] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:14:59.556747 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c0af23da-b0cf-4357-a0d5-dc2013a4bf77 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:59.557477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c0af23da-b0cf-4357-a0d5-dc2013a4bf77 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:59.559779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ef2396b8-776a-4de3-8532-f148163b9b12 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:59.561700 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ef2396b8-776a-4de3-8532-f148163b9b12 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:59.563804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0af23da-b0cf-4357-a0d5-dc2013a4bf77 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:59.567371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0af23da-b0cf-4357-a0d5-dc2013a4bf77 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:59.567371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0af23da-b0cf-4357-a0d5-dc2013a4bf77 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:59.567371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0af23da-b0cf-4357-a0d5-dc2013a4bf77 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:59.567371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0af23da-b0cf-4357-a0d5-dc2013a4bf77 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:59.568016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c0af23da-b0cf-4357-a0d5-dc2013a4bf77 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:59.574539 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef2396b8-776a-4de3-8532-f148163b9b12 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:59.575671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef2396b8-776a-4de3-8532-f148163b9b12 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:59.576530 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef2396b8-776a-4de3-8532-f148163b9b12 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:59.577786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef2396b8-776a-4de3-8532-f148163b9b12 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:59.578703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef2396b8-776a-4de3-8532-f148163b9b12 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:59.579494 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ef2396b8-776a-4de3-8532-f148163b9b12 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:59.778795 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c0af23da-b0cf-4357-a0d5-dc2013a4bf77 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:59.784098 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ef2396b8-776a-4de3-8532-f148163b9b12 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:14:59.787120 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c0af23da-b0cf-4357-a0d5-dc2013a4bf77 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1362 microversion: 2.1 time: 0.234485 Sep 14 12:14:59.787692 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 459/914] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:59 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:14:59.792144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-172bbc47-dd1b-4ea8-8449-f7200c7dcc2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:14:59.792633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-172bbc47-dd1b-4ea8-8449-f7200c7dcc2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:14:59.797560 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ef2396b8-776a-4de3-8532-f148163b9b12 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.246002 Sep 14 12:14:59.798848 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 456/915] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:14:59 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:14:59.801577 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-172bbc47-dd1b-4ea8-8449-f7200c7dcc2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:59.802491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-172bbc47-dd1b-4ea8-8449-f7200c7dcc2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:59.803273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-172bbc47-dd1b-4ea8-8449-f7200c7dcc2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:59.804637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-172bbc47-dd1b-4ea8-8449-f7200c7dcc2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:14:59.805697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-172bbc47-dd1b-4ea8-8449-f7200c7dcc2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:14:59.806721 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-172bbc47-dd1b-4ea8-8449-f7200c7dcc2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:14:59.839093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-172bbc47-dd1b-4ea8-8449-f7200c7dcc2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Going to try to terminate instance {{(pid=121152) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:15:00.101123 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-172bbc47-dd1b-4ea8-8449-f7200c7dcc2f tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 204 len: 0 microversion: 2.1 time: 0.312133 Sep 14 12:15:00.101729 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 460/916] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:14:59 2022] DELETE /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:15:00.109889 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7e3913ea-2860-4f62-bdd9-697ff2e3a897 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:00.110509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7e3913ea-2860-4f62-bdd9-697ff2e3a897 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:00.116447 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e3913ea-2860-4f62-bdd9-697ff2e3a897 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:00.116933 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e3913ea-2860-4f62-bdd9-697ff2e3a897 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:00.117371 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e3913ea-2860-4f62-bdd9-697ff2e3a897 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:00.118177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e3913ea-2860-4f62-bdd9-697ff2e3a897 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:00.118630 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e3913ea-2860-4f62-bdd9-697ff2e3a897 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:00.119053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e3913ea-2860-4f62-bdd9-697ff2e3a897 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:00.252027 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7e3913ea-2860-4f62-bdd9-697ff2e3a897 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:00.259810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7e3913ea-2860-4f62-bdd9-697ff2e3a897 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1507 microversion: 2.1 time: 0.153785 Sep 14 12:15:00.260376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 457/917] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:00 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:00.823361 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bf86e2e9-8ad7-454e-8ab8-5b60a01825a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:00.824068 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-bf86e2e9-8ad7-454e-8ab8-5b60a01825a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:00.828026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7548d96e-35f9-4c71-a8da-c18b1531c9a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:00.828922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7548d96e-35f9-4c71-a8da-c18b1531c9a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:00.830807 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf86e2e9-8ad7-454e-8ab8-5b60a01825a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:00.831737 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf86e2e9-8ad7-454e-8ab8-5b60a01825a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:00.835454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf86e2e9-8ad7-454e-8ab8-5b60a01825a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:00.835454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf86e2e9-8ad7-454e-8ab8-5b60a01825a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:00.835454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf86e2e9-8ad7-454e-8ab8-5b60a01825a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:00.835454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bf86e2e9-8ad7-454e-8ab8-5b60a01825a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:00.839779 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7548d96e-35f9-4c71-a8da-c18b1531c9a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:00.840276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7548d96e-35f9-4c71-a8da-c18b1531c9a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:00.840712 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7548d96e-35f9-4c71-a8da-c18b1531c9a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:00.841413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7548d96e-35f9-4c71-a8da-c18b1531c9a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:00.841879 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7548d96e-35f9-4c71-a8da-c18b1531c9a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:00.842324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7548d96e-35f9-4c71-a8da-c18b1531c9a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:01.033500 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bf86e2e9-8ad7-454e-8ab8-5b60a01825a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:01.037445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7548d96e-35f9-4c71-a8da-c18b1531c9a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:01.041386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bf86e2e9-8ad7-454e-8ab8-5b60a01825a5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.222355 Sep 14 12:15:01.041989 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 461/918] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:00 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:01.045385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7548d96e-35f9-4c71-a8da-c18b1531c9a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1362 microversion: 2.1 time: 0.222330 Sep 14 12:15:01.046529 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 458/919] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:00 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:15:01.283956 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f6d87bbb-1f30-4985-9e79-0bf1565b087b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:01.284482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f6d87bbb-1f30-4985-9e79-0bf1565b087b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:01.290516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6d87bbb-1f30-4985-9e79-0bf1565b087b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:01.290993 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6d87bbb-1f30-4985-9e79-0bf1565b087b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:01.291458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6d87bbb-1f30-4985-9e79-0bf1565b087b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:01.292137 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6d87bbb-1f30-4985-9e79-0bf1565b087b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:01.292585 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6d87bbb-1f30-4985-9e79-0bf1565b087b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:01.293002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f6d87bbb-1f30-4985-9e79-0bf1565b087b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:01.428345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f6d87bbb-1f30-4985-9e79-0bf1565b087b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:01.436105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f6d87bbb-1f30-4985-9e79-0bf1565b087b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1507 microversion: 2.1 time: 0.156639 Sep 14 12:15:01.436675 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 462/920] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:01 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:02.067051 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5700f5cf-ab13-4265-b913-932fefb5e464 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:02.067669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5700f5cf-ab13-4265-b913-932fefb5e464 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:02.069759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7018f33a-b054-4d03-8077-2c47b342fc8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:02.070445 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7018f33a-b054-4d03-8077-2c47b342fc8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:02.074264 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5700f5cf-ab13-4265-b913-932fefb5e464 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:02.074836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5700f5cf-ab13-4265-b913-932fefb5e464 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:02.075223 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5700f5cf-ab13-4265-b913-932fefb5e464 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:02.075922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5700f5cf-ab13-4265-b913-932fefb5e464 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:02.076379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5700f5cf-ab13-4265-b913-932fefb5e464 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:02.076812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5700f5cf-ab13-4265-b913-932fefb5e464 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:02.076961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7018f33a-b054-4d03-8077-2c47b342fc8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:02.078202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7018f33a-b054-4d03-8077-2c47b342fc8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:02.078599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7018f33a-b054-4d03-8077-2c47b342fc8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:02.079285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7018f33a-b054-4d03-8077-2c47b342fc8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:02.079728 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7018f33a-b054-4d03-8077-2c47b342fc8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:02.080142 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7018f33a-b054-4d03-8077-2c47b342fc8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:02.082093 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:02.277554 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5700f5cf-ab13-4265-b913-932fefb5e464 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:02.285527 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7018f33a-b054-4d03-8077-2c47b342fc8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:02.286334 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5700f5cf-ab13-4265-b913-932fefb5e464 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.223612 Sep 14 12:15:02.286919 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 459/921] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:02 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:02.293606 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7018f33a-b054-4d03-8077-2c47b342fc8e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1362 microversion: 2.1 time: 0.227551 Sep 14 12:15:02.294214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 463/922] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:02 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:15:02.459364 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bfdd1606-8f7e-4705-b050-afc73b655d95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:02.461345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bfdd1606-8f7e-4705-b050-afc73b655d95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:02.463244 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:02.464080 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=14 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:02.477434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfdd1606-8f7e-4705-b050-afc73b655d95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:02.481011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfdd1606-8f7e-4705-b050-afc73b655d95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:02.481011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfdd1606-8f7e-4705-b050-afc73b655d95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:02.481011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfdd1606-8f7e-4705-b050-afc73b655d95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:02.481011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfdd1606-8f7e-4705-b050-afc73b655d95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:02.481369 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bfdd1606-8f7e-4705-b050-afc73b655d95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:02.655670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bfdd1606-8f7e-4705-b050-afc73b655d95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:02.664392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bfdd1606-8f7e-4705-b050-afc73b655d95 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1507 microversion: 2.1 time: 0.209049 Sep 14 12:15:02.664956 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 460/923] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:02 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:03.314820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-eb829081-3577-4084-ac52-0219eee2079a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:03.316100 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-eb829081-3577-4084-ac52-0219eee2079a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:03.318251 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=6 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:03.318412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-060c797f-1f70-4c25-8b41-5c89fc38e81f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:03.318891 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-060c797f-1f70-4c25-8b41-5c89fc38e81f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:03.323723 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb829081-3577-4084-ac52-0219eee2079a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:03.324453 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb829081-3577-4084-ac52-0219eee2079a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:03.324600 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb829081-3577-4084-ac52-0219eee2079a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:03.325471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb829081-3577-4084-ac52-0219eee2079a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:03.325941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb829081-3577-4084-ac52-0219eee2079a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:03.326512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb829081-3577-4084-ac52-0219eee2079a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:03.326631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060c797f-1f70-4c25-8b41-5c89fc38e81f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:03.327080 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060c797f-1f70-4c25-8b41-5c89fc38e81f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:03.327688 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060c797f-1f70-4c25-8b41-5c89fc38e81f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:03.328611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060c797f-1f70-4c25-8b41-5c89fc38e81f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:03.329280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060c797f-1f70-4c25-8b41-5c89fc38e81f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:03.329920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060c797f-1f70-4c25-8b41-5c89fc38e81f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:03.536173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-eb829081-3577-4084-ac52-0219eee2079a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:03.539748 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-060c797f-1f70-4c25-8b41-5c89fc38e81f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:03.548692 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-060c797f-1f70-4c25-8b41-5c89fc38e81f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1362 microversion: 2.1 time: 0.234517 Sep 14 12:15:03.549913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 461/924] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:03 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:15:03.551584 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-eb829081-3577-4084-ac52-0219eee2079a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.240946 Sep 14 12:15:03.552163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 464/925] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:03 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:15:03.687508 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-277db137-7520-4210-9458-fd89dda17293 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:03.688034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-277db137-7520-4210-9458-fd89dda17293 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:03.693939 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-277db137-7520-4210-9458-fd89dda17293 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:03.694426 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-277db137-7520-4210-9458-fd89dda17293 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:03.694864 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-277db137-7520-4210-9458-fd89dda17293 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:03.695556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-277db137-7520-4210-9458-fd89dda17293 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:03.696005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-277db137-7520-4210-9458-fd89dda17293 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:03.696431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-277db137-7520-4210-9458-fd89dda17293 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:03.829039 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-277db137-7520-4210-9458-fd89dda17293 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:03.837087 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-277db137-7520-4210-9458-fd89dda17293 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1507 microversion: 2.1 time: 0.153527 Sep 14 12:15:03.837661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 462/926] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:03 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:04.512401 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-d3bad9e7-9ec1-4d32-ac11-5e9e66b8def5 req-a466f63f-196c-496a-8b6d-80af0dc9824e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f808ebd-698e-480a-9eac-4ef62bcc2b7b", "name": "network-vif-deleted", "tag": "de5f0781-b564-4893-84ac-ebcb69c0ddc9"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:15:04.522531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-d3bad9e7-9ec1-4d32-ac11-5e9e66b8def5 req-a466f63f-196c-496a-8b6d-80af0dc9824e service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:04.523009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-d3bad9e7-9ec1-4d32-ac11-5e9e66b8def5 req-a466f63f-196c-496a-8b6d-80af0dc9824e service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:04.523437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-d3bad9e7-9ec1-4d32-ac11-5e9e66b8def5 req-a466f63f-196c-496a-8b6d-80af0dc9824e service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:04.535043 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-d3bad9e7-9ec1-4d32-ac11-5e9e66b8def5 req-a466f63f-196c-496a-8b6d-80af0dc9824e service nova] Creating event network-vif-deleted:de5f0781-b564-4893-84ac-ebcb69c0ddc9 for instance 3f808ebd-698e-480a-9eac-4ef62bcc2b7b on hv-cinder-84496 Sep 14 12:15:04.540172 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-d3bad9e7-9ec1-4d32-ac11-5e9e66b8def5 req-a466f63f-196c-496a-8b6d-80af0dc9824e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031567 Sep 14 12:15:04.540760 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 465/927] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:15:04.571682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2fba9e8d-6bc9-4756-8bab-d8c3cf20aa4a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:04.572274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2fba9e8d-6bc9-4756-8bab-d8c3cf20aa4a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:04.576452 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-07824236-0b55-4fec-9b5e-b21efdb6e0a3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:04.579318 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-07824236-0b55-4fec-9b5e-b21efdb6e0a3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:04.579497 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fba9e8d-6bc9-4756-8bab-d8c3cf20aa4a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:04.579669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fba9e8d-6bc9-4756-8bab-d8c3cf20aa4a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:04.580110 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fba9e8d-6bc9-4756-8bab-d8c3cf20aa4a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:04.580815 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fba9e8d-6bc9-4756-8bab-d8c3cf20aa4a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:04.581270 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fba9e8d-6bc9-4756-8bab-d8c3cf20aa4a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:04.581697 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2fba9e8d-6bc9-4756-8bab-d8c3cf20aa4a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:04.584572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07824236-0b55-4fec-9b5e-b21efdb6e0a3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:04.585059 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07824236-0b55-4fec-9b5e-b21efdb6e0a3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:04.585495 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07824236-0b55-4fec-9b5e-b21efdb6e0a3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:04.586606 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07824236-0b55-4fec-9b5e-b21efdb6e0a3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:04.586743 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07824236-0b55-4fec-9b5e-b21efdb6e0a3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:04.587115 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-07824236-0b55-4fec-9b5e-b21efdb6e0a3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:04.802521 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2fba9e8d-6bc9-4756-8bab-d8c3cf20aa4a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:04.802866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-07824236-0b55-4fec-9b5e-b21efdb6e0a3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:04.802997 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2fba9e8d-6bc9-4756-8bab-d8c3cf20aa4a tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1362 microversion: 2.1 time: 0.222757 Sep 14 12:15:04.802997 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 463/928] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:04 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:04.803200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-07824236-0b55-4fec-9b5e-b21efdb6e0a3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1367 microversion: 2.1 time: 0.225086 Sep 14 12:15:04.803200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 466/929] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:04 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:15:04.861224 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8cb6c9a1-0185-40fa-b378-7624a686c363 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:04.861838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8cb6c9a1-0185-40fa-b378-7624a686c363 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:04.868141 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cb6c9a1-0185-40fa-b378-7624a686c363 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:04.868632 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cb6c9a1-0185-40fa-b378-7624a686c363 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:04.869074 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cb6c9a1-0185-40fa-b378-7624a686c363 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:04.869771 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cb6c9a1-0185-40fa-b378-7624a686c363 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:04.870255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cb6c9a1-0185-40fa-b378-7624a686c363 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:04.870674 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8cb6c9a1-0185-40fa-b378-7624a686c363 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:04.948914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8cb6c9a1-0185-40fa-b378-7624a686c363 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:04.958379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8cb6c9a1-0185-40fa-b378-7624a686c363 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1292 microversion: 2.1 time: 0.101551 Sep 14 12:15:04.958978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 464/930] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:04 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:15:05.602338 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-95f08e9a-6409-4b40-8d22-ae8e7daa064d req-6e553e87-6bd1-44f1-b93f-ff89def8a6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637a4311-34dd-4f5e-b0c9-e32ec1a8a12b", "name": "network-vif-plugged", "status": "completed", "tag": "10f04e67-d152-402d-b0fd-e0db630ba32c"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:15:05.613381 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-95f08e9a-6409-4b40-8d22-ae8e7daa064d req-6e553e87-6bd1-44f1-b93f-ff89def8a6a2 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:05.613980 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-95f08e9a-6409-4b40-8d22-ae8e7daa064d req-6e553e87-6bd1-44f1-b93f-ff89def8a6a2 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:05.614342 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-95f08e9a-6409-4b40-8d22-ae8e7daa064d req-6e553e87-6bd1-44f1-b93f-ff89def8a6a2 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:05.626380 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-95f08e9a-6409-4b40-8d22-ae8e7daa064d req-6e553e87-6bd1-44f1-b93f-ff89def8a6a2 service nova] Creating event network-vif-plugged:10f04e67-d152-402d-b0fd-e0db630ba32c for instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b on hv-cinder-84496 Sep 14 12:15:05.631121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-95f08e9a-6409-4b40-8d22-ae8e7daa064d req-6e553e87-6bd1-44f1-b93f-ff89def8a6a2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032597 Sep 14 12:15:05.631718 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 467/931] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:15:05.815648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4c8749c0-aedd-4d5d-aa1c-25c0fcfa8a12 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:05.816844 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4c8749c0-aedd-4d5d-aa1c-25c0fcfa8a12 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:05.824077 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c8749c0-aedd-4d5d-aa1c-25c0fcfa8a12 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:05.826425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c8749c0-aedd-4d5d-aa1c-25c0fcfa8a12 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:05.826425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c8749c0-aedd-4d5d-aa1c-25c0fcfa8a12 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:05.826425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c8749c0-aedd-4d5d-aa1c-25c0fcfa8a12 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:05.826425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c8749c0-aedd-4d5d-aa1c-25c0fcfa8a12 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:05.827899 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4c8749c0-aedd-4d5d-aa1c-25c0fcfa8a12 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:05.835303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-59139e3d-198c-41d0-9e9f-e15c0d74963b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:05.836028 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-59139e3d-198c-41d0-9e9f-e15c0d74963b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:05.843148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59139e3d-198c-41d0-9e9f-e15c0d74963b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:05.843701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59139e3d-198c-41d0-9e9f-e15c0d74963b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:05.844148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59139e3d-198c-41d0-9e9f-e15c0d74963b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:05.844854 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59139e3d-198c-41d0-9e9f-e15c0d74963b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:05.845308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59139e3d-198c-41d0-9e9f-e15c0d74963b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:05.845738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59139e3d-198c-41d0-9e9f-e15c0d74963b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:06.037464 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4c8749c0-aedd-4d5d-aa1c-25c0fcfa8a12 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:06.046883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-59139e3d-198c-41d0-9e9f-e15c0d74963b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:06.049623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4c8749c0-aedd-4d5d-aa1c-25c0fcfa8a12 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1362 microversion: 2.1 time: 0.238470 Sep 14 12:15:06.050635 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 465/932] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:05 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:06.058451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:06.059431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:06.059547 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-59139e3d-198c-41d0-9e9f-e15c0d74963b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1556 microversion: 2.1 time: 0.242612 Sep 14 12:15:06.060362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 468/933] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:05 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1556 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:15:06.067063 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:06.067616 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:06.068111 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:06.068870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:06.069380 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:06.069889 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:06.082940 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-625c51df-3ef9-4e70-b683-b29dbd42715e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:06.083431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-625c51df-3ef9-4e70-b683-b29dbd42715e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:06.090192 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625c51df-3ef9-4e70-b683-b29dbd42715e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:06.090685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625c51df-3ef9-4e70-b683-b29dbd42715e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:06.091121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625c51df-3ef9-4e70-b683-b29dbd42715e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:06.091822 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625c51df-3ef9-4e70-b683-b29dbd42715e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:06.092282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625c51df-3ef9-4e70-b683-b29dbd42715e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:06.092701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625c51df-3ef9-4e70-b683-b29dbd42715e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:06.103475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:06.103958 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:06.104391 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:06.104841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lazy-loading 'fault' on Instance uuid 3f808ebd-698e-480a-9eac-4ef62bcc2b7b {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:15:06.176925 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:06.196061 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-72faa0d9-5b4d-4fe3-8d71-c924f570efc0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 200 len: 1311 microversion: 2.1 time: 0.144081 Sep 14 12:15:06.196667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 466/934] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:06 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 1311 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:06.214439 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-625c51df-3ef9-4e70-b683-b29dbd42715e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135220 Sep 14 12:15:06.215260 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 469/935] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 14 12:15:06 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:15:07.073229 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b9cde135-0d54-41bc-adf8-130382dc05d1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:07.073808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b9cde135-0d54-41bc-adf8-130382dc05d1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:07.081729 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9cde135-0d54-41bc-adf8-130382dc05d1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:07.082266 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9cde135-0d54-41bc-adf8-130382dc05d1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:07.082716 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9cde135-0d54-41bc-adf8-130382dc05d1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:07.083441 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9cde135-0d54-41bc-adf8-130382dc05d1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:07.083903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9cde135-0d54-41bc-adf8-130382dc05d1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:07.084339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b9cde135-0d54-41bc-adf8-130382dc05d1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:07.220826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:07.222601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 3f808ebd-698e-480a-9eac-4ef62bcc2b7b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:07.229434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:07.230022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:07.230396 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b9cde135-0d54-41bc-adf8-130382dc05d1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:07.230643 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:07.231545 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:07.235653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:07.235653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:07.238721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b9cde135-0d54-41bc-adf8-130382dc05d1 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1362 microversion: 2.1 time: 0.169414 Sep 14 12:15:07.239486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 467/936] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:07 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:07.249845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] HTTP exception thrown: Instance 3f808ebd-698e-480a-9eac-4ef62bcc2b7b could not be found. Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Request method failure captured: Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b HTTP/1.1 Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcO0QaCS6xXTzM6jpZKpig5OWwgN4DxcmFTi61vISCiYbIqj92GCFK2Ykao8lOPtpzCjwB5UFh2EALT9e-6aRP6sfCRAMRClNQTuYs6OK-1skVV-bbMgM1Rb_IgbUayTgQvhQjd_qmnAYRMCxoLQ6qRy3J7d-3d9WDsecW3_-xRcxwM Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 748b7c08460b4f718dfff67275d8e4e4 Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:15:07.251550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/748b7c08460b4f718dfff67275d8e4e4"}]}] Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 748b7c08460b4f718dfff67275d8e4e4 Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-ServerRescueNegativeTestJSON-761218752-project Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 4bd4125ff6bb400bae1b94df7d2cfa17 Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-ServerRescueNegativeTestJSON-761218752-project Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 3f808ebd-698e-480a-9eac-4ef62bcc2b7b could not be found. Sep 14 12:15:07.252881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '3f808ebd-698e-480a-9eac-4ef62bcc2b7b'} Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f808ebd-698e-480a-9eac-4ef62bcc2b7b could not be found. Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:15:07.253803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f808ebd-698e-480a-9eac-4ef62bcc2b7b could not be found. Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f808ebd-698e-480a-9eac-4ef62bcc2b7b could not be found. Sep 14 12:15:07.255337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:15:07.256594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Returning 404 to user: Instance 3f808ebd-698e-480a-9eac-4ef62bcc2b7b could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:15:07.256594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2ad649dd-ed4e-4b90-9500-58e00e46a11e tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b" status: 404 len: 111 microversion: 2.1 time: 0.037589 Sep 14 12:15:07.256594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 470/937] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:07 2022] GET /compute/v2.1/servers/3f808ebd-698e-480a-9eac-4ef62bcc2b7b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:15:07.261758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d99dacf1-df00-4dbc-8aa7-0db3f69261d4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:07.262289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d99dacf1-df00-4dbc-8aa7-0db3f69261d4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:07.268951 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d99dacf1-df00-4dbc-8aa7-0db3f69261d4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:07.269452 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d99dacf1-df00-4dbc-8aa7-0db3f69261d4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:07.269920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d99dacf1-df00-4dbc-8aa7-0db3f69261d4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:07.270628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d99dacf1-df00-4dbc-8aa7-0db3f69261d4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:07.271091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d99dacf1-df00-4dbc-8aa7-0db3f69261d4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:07.271548 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d99dacf1-df00-4dbc-8aa7-0db3f69261d4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:07.297254 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d99dacf1-df00-4dbc-8aa7-0db3f69261d4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:15:07.550516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-406ce5b5-ba12-45e6-90d3-24fada421bc4 req-15b6da3d-d909-4c6f-8fd7-a211054312ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6bf2654-f27a-4ec4-9dba-d70e557034df", "tag": "2f4cdaf2-f722-4368-bdce-05dda4448873"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:15:07.560224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-406ce5b5-ba12-45e6-90d3-24fada421bc4 req-15b6da3d-d909-4c6f-8fd7-a211054312ba service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:07.560702 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-406ce5b5-ba12-45e6-90d3-24fada421bc4 req-15b6da3d-d909-4c6f-8fd7-a211054312ba service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:07.561131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-406ce5b5-ba12-45e6-90d3-24fada421bc4 req-15b6da3d-d909-4c6f-8fd7-a211054312ba service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:07.573211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-406ce5b5-ba12-45e6-90d3-24fada421bc4 req-15b6da3d-d909-4c6f-8fd7-a211054312ba service nova] Creating event network-changed:2f4cdaf2-f722-4368-bdce-05dda4448873 for instance a6bf2654-f27a-4ec4-9dba-d70e557034df on hv-cinder-84496 Sep 14 12:15:07.579974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-406ce5b5-ba12-45e6-90d3-24fada421bc4 req-15b6da3d-d909-4c6f-8fd7-a211054312ba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098418 Sep 14 12:15:07.580695 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 471/938] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:15:07.668499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d99dacf1-df00-4dbc-8aa7-0db3f69261d4 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 204 len: 0 microversion: 2.1 time: 0.410253 Sep 14 12:15:07.669201 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 468/939] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:15:07 2022] DELETE /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 12:15:07.678669 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c2325df5-8696-44bf-91e6-a3d80fb92ae0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:07.679466 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c2325df5-8696-44bf-91e6-a3d80fb92ae0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:07.686051 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2325df5-8696-44bf-91e6-a3d80fb92ae0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:07.687170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2325df5-8696-44bf-91e6-a3d80fb92ae0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:07.688206 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2325df5-8696-44bf-91e6-a3d80fb92ae0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:07.688521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2325df5-8696-44bf-91e6-a3d80fb92ae0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:07.689067 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2325df5-8696-44bf-91e6-a3d80fb92ae0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:07.689545 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2325df5-8696-44bf-91e6-a3d80fb92ae0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:07.841374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c2325df5-8696-44bf-91e6-a3d80fb92ae0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:07.850139 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c2325df5-8696-44bf-91e6-a3d80fb92ae0 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.175633 Sep 14 12:15:07.850717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 472/940] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:07 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:15:08.265483 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d3d68e40-212d-4074-b5ba-e05368d4077b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:08.266391 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d3d68e40-212d-4074-b5ba-e05368d4077b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:08.273281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3d68e40-212d-4074-b5ba-e05368d4077b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:08.274217 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3d68e40-212d-4074-b5ba-e05368d4077b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:08.274778 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3d68e40-212d-4074-b5ba-e05368d4077b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:08.275718 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3d68e40-212d-4074-b5ba-e05368d4077b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:08.276283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3d68e40-212d-4074-b5ba-e05368d4077b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:08.277165 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3d68e40-212d-4074-b5ba-e05368d4077b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:08.431903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d3d68e40-212d-4074-b5ba-e05368d4077b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:08.440124 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d3d68e40-212d-4074-b5ba-e05368d4077b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1362 microversion: 2.1 time: 0.180344 Sep 14 12:15:08.440705 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 469/941] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:08 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:08.878906 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f3e81590-563e-4603-ba1f-344c7306b10b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:08.879701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f3e81590-563e-4603-ba1f-344c7306b10b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:08.886380 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f3e81590-563e-4603-ba1f-344c7306b10b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:08.886884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f3e81590-563e-4603-ba1f-344c7306b10b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:08.887328 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f3e81590-563e-4603-ba1f-344c7306b10b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:08.888036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f3e81590-563e-4603-ba1f-344c7306b10b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:08.888723 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f3e81590-563e-4603-ba1f-344c7306b10b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:08.889188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f3e81590-563e-4603-ba1f-344c7306b10b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:09.086876 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f3e81590-563e-4603-ba1f-344c7306b10b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:09.089428 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:09.096009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f3e81590-563e-4603-ba1f-344c7306b10b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1522 microversion: 2.1 time: 0.221023 Sep 14 12:15:09.096594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 473/942] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:08 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:15:09.463809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9526035a-2763-4fa1-9f49-79d8e88284fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:09.464445 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9526035a-2763-4fa1-9f49-79d8e88284fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:09.471115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9526035a-2763-4fa1-9f49-79d8e88284fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:09.471611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9526035a-2763-4fa1-9f49-79d8e88284fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:09.472053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9526035a-2763-4fa1-9f49-79d8e88284fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:09.472751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9526035a-2763-4fa1-9f49-79d8e88284fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:09.473210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9526035a-2763-4fa1-9f49-79d8e88284fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:09.473634 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9526035a-2763-4fa1-9f49-79d8e88284fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:09.690274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9526035a-2763-4fa1-9f49-79d8e88284fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:09.698305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9526035a-2763-4fa1-9f49-79d8e88284fb tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1548 microversion: 2.1 time: 0.238896 Sep 14 12:15:09.698888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 470/943] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:09 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1548 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:09.722961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4d757fd0-351e-4dd6-9bde-bdf8be08be99 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:09.723459 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4d757fd0-351e-4dd6-9bde-bdf8be08be99 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:09.730373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4d757fd0-351e-4dd6-9bde-bdf8be08be99 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:09.730913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4d757fd0-351e-4dd6-9bde-bdf8be08be99 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:09.731346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4d757fd0-351e-4dd6-9bde-bdf8be08be99 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:09.732041 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4d757fd0-351e-4dd6-9bde-bdf8be08be99 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:09.732535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4d757fd0-351e-4dd6-9bde-bdf8be08be99 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:09.732961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4d757fd0-351e-4dd6-9bde-bdf8be08be99 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:09.812930 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4d757fd0-351e-4dd6-9bde-bdf8be08be99 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093858 Sep 14 12:15:09.813748 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 474/944] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 14 12:15:09 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:15:09.925607 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-ac77c62e-7c1d-4f34-9138-5c9e20febff3 req-cd7d3d04-04de-47b4-92e2-2b95f60ae27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7649ff4f-2137-402c-a210-b4b9f4c95b82", "name": "network-vif-deleted", "tag": "1284ee63-88b4-458d-ab2c-4d6fca36d2a1"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:15:09.936508 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ac77c62e-7c1d-4f34-9138-5c9e20febff3 req-cd7d3d04-04de-47b4-92e2-2b95f60ae27b service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:09.936903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ac77c62e-7c1d-4f34-9138-5c9e20febff3 req-cd7d3d04-04de-47b4-92e2-2b95f60ae27b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:09.937341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ac77c62e-7c1d-4f34-9138-5c9e20febff3 req-cd7d3d04-04de-47b4-92e2-2b95f60ae27b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:09.948656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-ac77c62e-7c1d-4f34-9138-5c9e20febff3 req-cd7d3d04-04de-47b4-92e2-2b95f60ae27b service nova] Creating event network-vif-deleted:1284ee63-88b4-458d-ab2c-4d6fca36d2a1 for instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 on hv-cinder-84496 Sep 14 12:15:09.954758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-ac77c62e-7c1d-4f34-9138-5c9e20febff3 req-cd7d3d04-04de-47b4-92e2-2b95f60ae27b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033225 Sep 14 12:15:09.955455 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 471/945] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:15:10.127395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-41a0173f-8e26-4cd1-871d-97551c9645dc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:10.128027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-41a0173f-8e26-4cd1-871d-97551c9645dc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:10.134731 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-41a0173f-8e26-4cd1-871d-97551c9645dc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:10.135211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-41a0173f-8e26-4cd1-871d-97551c9645dc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:10.135638 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-41a0173f-8e26-4cd1-871d-97551c9645dc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:10.136318 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-41a0173f-8e26-4cd1-871d-97551c9645dc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:10.136762 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-41a0173f-8e26-4cd1-871d-97551c9645dc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:10.137176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-41a0173f-8e26-4cd1-871d-97551c9645dc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:10.207034 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-41a0173f-8e26-4cd1-871d-97551c9645dc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:10.215908 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-41a0173f-8e26-4cd1-871d-97551c9645dc tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1307 microversion: 2.1 time: 0.093311 Sep 14 12:15:10.216513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 475/946] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:10 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:10.910531 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-c646dfa5-8bea-46bb-9a2c-ccc8f4335635 req-36d49c49-98c8-411b-ad8a-ed3e58552461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637a4311-34dd-4f5e-b0c9-e32ec1a8a12b", "tag": "10f04e67-d152-402d-b0fd-e0db630ba32c"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:15:10.920915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-c646dfa5-8bea-46bb-9a2c-ccc8f4335635 req-36d49c49-98c8-411b-ad8a-ed3e58552461 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:10.921397 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-c646dfa5-8bea-46bb-9a2c-ccc8f4335635 req-36d49c49-98c8-411b-ad8a-ed3e58552461 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:10.921835 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-c646dfa5-8bea-46bb-9a2c-ccc8f4335635 req-36d49c49-98c8-411b-ad8a-ed3e58552461 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:10.933190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-c646dfa5-8bea-46bb-9a2c-ccc8f4335635 req-36d49c49-98c8-411b-ad8a-ed3e58552461 service nova] Creating event network-changed:10f04e67-d152-402d-b0fd-e0db630ba32c for instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b on hv-cinder-84496 Sep 14 12:15:10.938813 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-c646dfa5-8bea-46bb-9a2c-ccc8f4335635 req-36d49c49-98c8-411b-ad8a-ed3e58552461 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032212 Sep 14 12:15:10.939422 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 472/947] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:15:11.241066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:11.242438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:11.253195 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:11.254095 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:11.254755 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:11.257048 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:11.258169 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:11.258935 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:11.323810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:11.324623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:11.325721 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:11.326977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lazy-loading 'fault' on Instance uuid 7649ff4f-2137-402c-a210-b4b9f4c95b82 {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:15:11.395381 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd4125ff6bb400bae1b94df7d2cfa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748b7c08460b4f718dfff67275d8e4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:11.405071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-83067e20-086d-42d2-ae04-9a8959832fb9 tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 200 len: 1312 microversion: 2.1 time: 0.169002 Sep 14 12:15:11.406217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 476/948] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:11 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:12.430326 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:12.431037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] [instance: 7649ff4f-2137-402c-a210-b4b9f4c95b82] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:12.437825 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:12.438341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:12.438788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:12.439487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:12.439944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:12.440377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:12.454356 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] HTTP exception thrown: Instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 could not be found. Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Request method failure captured: Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 HTTP/1.1 Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcO0QaCS6xXTzM6jpZKpig5OWwgN4DxcmFTi61vISCiYbIqj92GCFK2Ykao8lOPtpzCjwB5UFh2EALT9e-6aRP6sfCRAMRClNQTuYs6OK-1skVV-bbMgM1Rb_IgbUayTgQvhQjd_qmnAYRMCxoLQ6qRy3J7d-3d9WDsecW3_-xRcxwM Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 748b7c08460b4f718dfff67275d8e4e4 Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:15:12.456020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_748b7c08460b4f718dfff67275d8e4e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/748b7c08460b4f718dfff67275d8e4e4"}]}] Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 748b7c08460b4f718dfff67275d8e4e4 Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-761218752 Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-ServerRescueNegativeTestJSON-761218752-project Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 4bd4125ff6bb400bae1b94df7d2cfa17 Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-ServerRescueNegativeTestJSON-761218752-project Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 could not be found. Sep 14 12:15:12.457602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '7649ff4f-2137-402c-a210-b4b9f4c95b82'} Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 could not be found. Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:15:12.458545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 could not be found. Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 could not be found. Sep 14 12:15:12.460019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:15:12.461202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] Returning 404 to user: Instance 7649ff4f-2137-402c-a210-b4b9f4c95b82 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:15:12.461202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a3339eca-226a-4531-b04c-0ebbd00a4d5b tempest-ServerRescueNegativeTestJSON-761218752 tempest-ServerRescueNegativeTestJSON-761218752-project] 10.222.0.62 "GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82" status: 404 len: 111 microversion: 2.1 time: 0.031998 Sep 14 12:15:12.461202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 473/949] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:15:12 2022] GET /compute/v2.1/servers/7649ff4f-2137-402c-a210-b4b9f4c95b82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:15:21.362951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1db229da-82cc-4a21-bd7b-50cec752483c tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99b0b820>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:21.370136 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:21.400654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=19 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:21.414756 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1db229da-82cc-4a21-bd7b-50cec752483c tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/800bb1ac-d008-4ef5-93b2-418859a9eda2" status: 200 len: 351 microversion: 2.1 time: 0.056371 Sep 14 12:15:21.422088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 477/950] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:15:21 2022] GET /compute/v2.1/os-volumes/800bb1ac-d008-4ef5-93b2-418859a9eda2 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:15:24.169009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c417152b-fc7e-42a8-97a7-de15a0b69567 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99d2c4c0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:24.177073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:24.177819 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:24.219483 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c417152b-fc7e-42a8-97a7-de15a0b69567 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f0fb415b-7281-487c-8a10-93132fcf1cd5" status: 200 len: 351 microversion: 2.1 time: 0.054329 Sep 14 12:15:24.220142 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 474/951] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:15:24 2022] GET /compute/v2.1/os-volumes/f0fb415b-7281-487c-8a10-93132fcf1cd5 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:15:26.861178 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bf242a7c-8fac-478e-b83b-530f35ad8c38 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99aee5e0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:26.909964 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bf242a7c-8fac-478e-b83b-530f35ad8c38 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/2bee1a8c-e4e4-4b27-bd5b-3bf2ba7c69c5" status: 200 len: 351 microversion: 2.1 time: 0.054078 Sep 14 12:15:26.910521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 478/952] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:15:26 2022] GET /compute/v2.1/os-volumes/2bee1a8c-e4e4-4b27-bd5b-3bf2ba7c69c5 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:15:26.925100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8ad54282-c9c7-4869-8d01-5d93b89b2670 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99d5be50>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:27.010229 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8ad54282-c9c7-4869-8d01-5d93b89b2670 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089787 Sep 14 12:15:27.013025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 475/953] 10.222.0.62 () {58 vars in 1134 bytes} [Wed Sep 14 12:15:26 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:27.025756 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3dcd4b21-831d-4857-85e2-315aa37e7ccc tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99b6a0d0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:27.109576 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3dcd4b21-831d-4857-85e2-315aa37e7ccc tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087756 Sep 14 12:15:27.110190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 479/954] 10.222.0.62 () {58 vars in 1149 bytes} [Wed Sep 14 12:15:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:15:27.124473 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9b99c3ab-95d6-4e59-87e9-b171269ac005 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99d40430>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:27.211404 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9b99c3ab-95d6-4e59-87e9-b171269ac005 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.091134 Sep 14 12:15:27.211982 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 476/955] 10.222.0.62 () {58 vars in 1134 bytes} [Wed Sep 14 12:15:27 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:27.225686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4c4b2d93-66ea-4df0-97d8-4de8b508551f tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99a84280>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:27.311368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4c4b2d93-66ea-4df0-97d8-4de8b508551f tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089557 Sep 14 12:15:27.311936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 480/956] 10.222.0.62 () {58 vars in 1167 bytes} [Wed Sep 14 12:15:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:15:27.325437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-66d550e5-a399-4e37-b8a6-cde563233289 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99fdcdc0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:27.408350 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-66d550e5-a399-4e37-b8a6-cde563233289 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086663 Sep 14 12:15:27.408922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 477/957] 10.222.0.62 () {58 vars in 1170 bytes} [Wed Sep 14 12:15:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:15:27.422972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6fcb7f45-7fcb-4b46-8a46-1d5f4a702f9b tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99a84af0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:27.504535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6fcb7f45-7fcb-4b46-8a46-1d5f4a702f9b tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085756 Sep 14 12:15:27.505124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 481/958] 10.222.0.62 () {58 vars in 1155 bytes} [Wed Sep 14 12:15:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:27.518757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f5439ebf-2d8a-4d70-99ec-a5d0ce9dd8df tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99d5b790>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:27.606353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f5439ebf-2d8a-4d70-99ec-a5d0ce9dd8df tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091610 Sep 14 12:15:27.607036 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 478/959] 10.222.0.62 () {58 vars in 1188 bytes} [Wed Sep 14 12:15:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:15:27.621399 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-67deeb3d-4f17-4e72-bdf1-5343f0417903 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] Calling method '.version_select at 0x7f1c99bafca0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:27.707287 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-67deeb3d-4f17-4e72-bdf1-5343f0417903 tempest-VolumesTestJSON-1642041091 tempest-VolumesTestJSON-1642041091-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089677 Sep 14 12:15:27.707860 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 482/960] 10.222.0.62 () {58 vars in 1155 bytes} [Wed Sep 14 12:15:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:15:42.100809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b3002b9a-3046-4afc-894e-02dfe834bdd2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:42.102121 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b3002b9a-3046-4afc-894e-02dfe834bdd2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:42.108679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3002b9a-3046-4afc-894e-02dfe834bdd2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:42.109177 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3002b9a-3046-4afc-894e-02dfe834bdd2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:42.109629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3002b9a-3046-4afc-894e-02dfe834bdd2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:42.110387 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3002b9a-3046-4afc-894e-02dfe834bdd2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:42.110850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3002b9a-3046-4afc-894e-02dfe834bdd2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:42.111283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b3002b9a-3046-4afc-894e-02dfe834bdd2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:42.136724 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b3002b9a-3046-4afc-894e-02dfe834bdd2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/ips" status: 200 len: 150 microversion: 2.20 time: 0.041185 Sep 14 12:15:42.139432 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 479/961] 10.222.0.62 () {60 vars in 1289 bytes} [Wed Sep 14 12:15:42 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:15:45.643072 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b3c3cf74-264c-48fc-9467-dd4ab4707409 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:15:45.644477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b3c3cf74-264c-48fc-9467-dd4ab4707409 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:45.651506 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b3c3cf74-264c-48fc-9467-dd4ab4707409 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:45.652005 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b3c3cf74-264c-48fc-9467-dd4ab4707409 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:45.652545 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b3c3cf74-264c-48fc-9467-dd4ab4707409 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:45.653166 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b3c3cf74-264c-48fc-9467-dd4ab4707409 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:45.653617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b3c3cf74-264c-48fc-9467-dd4ab4707409 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:45.654076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b3c3cf74-264c-48fc-9467-dd4ab4707409 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:45.678017 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-b3c3cf74-264c-48fc-9467-dd4ab4707409 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lazy-loading 'flavor' on Instance uuid 2a8a5c35-addb-48f1-928a-c53c742fbe4c {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:15:46.412040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b3c3cf74-264c-48fc-9467-dd4ab4707409 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "POST /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/action" status: 202 len: 0 microversion: 2.20 time: 0.774645 Sep 14 12:15:46.412629 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 483/962] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Sep 14 12:15:45 2022] POST /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/action => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:15:46.422240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:46.422904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:46.429652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:46.430153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:46.430622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:46.431530 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:46.432888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:46.432888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:46.586842 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:46.597386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:46.599010 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:46.600396 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-01053502-9c0a-4242-a543-533ecd57ca28 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.183292 Sep 14 12:15:46.601325 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 480/963] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:46 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:15:47.633157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:47.633992 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:47.641123 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:47.641609 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:47.642071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:47.642763 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:47.643209 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:47.643625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:47.781828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:47.793575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:47.795048 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:47.796210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-29d3ab6d-8406-4b14-b6cc-a148c81a3d3a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.169425 Sep 14 12:15:47.796774 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 484/964] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:47 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:15:48.822840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:48.823437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:48.830508 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:48.831146 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:48.831588 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:48.832821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:48.833275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:48.833723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:48.986199 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:48.994355 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:48.995847 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:48.997023 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-05f16597-3061-44e8-ad78-2513fbb5c880 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.178227 Sep 14 12:15:48.997584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 481/965] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:48 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:15:50.022152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:50.022804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:50.029608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:50.030130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:50.030563 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:50.031244 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:50.031689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:50.032102 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:50.166705 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:50.174808 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:50.176843 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:50.178015 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f97e4b68-b7fa-4689-9d6f-1b24f95f8496 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.159838 Sep 14 12:15:50.178577 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 485/966] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:50 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:15:51.203000 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:51.203614 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:51.210074 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:51.210567 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:51.211010 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:51.211709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:51.212169 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:51.212611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:51.340028 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:51.348365 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:51.349830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:51.351040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b116d128-c3b6-4225-8cf7-f50f96141007 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.151991 Sep 14 12:15:51.351625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 482/967] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:51 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:15:52.376732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:52.377334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:52.384303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:52.384785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:52.385215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:52.385931 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:52.386383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:52.386806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:52.516249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:52.525398 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:52.529131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:52.529131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-aad3998b-2641-4026-955a-bfe95e7a5df2 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.155269 Sep 14 12:15:52.529131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 486/968] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:52 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:15:53.554131 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:53.554721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:53.561226 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:53.561730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:53.562206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:53.562921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:53.563393 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:53.563834 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:53.704351 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:53.712986 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:53.714894 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:53.716081 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7b0b95df-dc66-4a98-b973-f8368fe17c21 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.166691 Sep 14 12:15:53.716653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 483/969] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:53 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:15:54.741682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:54.742414 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:54.749284 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:54.749795 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:54.750306 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:54.751089 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:54.751547 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:54.752060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:55.090275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:55.099383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:55.100849 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:55.102117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0c684f32-c946-4108-b03b-f0d35d118915 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.365039 Sep 14 12:15:55.102699 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 487/970] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:54 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:15:56.131133 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:56.132241 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:56.142726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:56.147761 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:56.147761 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:56.147761 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:56.147761 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:56.148882 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:56.342644 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:56.351489 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:56.355497 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:56.355497 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9ed00910-6e61-40d6-95b2-6478867ae208 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.230256 Sep 14 12:15:56.355497 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 484/971] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:56 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:15:57.395696 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:57.396308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:57.403231 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:57.403717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:57.404170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:57.404866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:57.405316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:57.405740 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:57.535683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:57.551489 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:57.552943 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:57.554152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ce944366-0aeb-40e3-9c92-9a1ddb20dc65 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.162469 Sep 14 12:15:57.554740 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 488/972] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:57 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:15:58.580490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:58.581107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:58.587651 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:58.588134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:58.588591 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:58.589318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:58.589766 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:58.590219 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:58.733023 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:58.742941 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:58.744507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:58.745669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1d8008cd-9a6f-45e8-8a41-1b73a24da2d6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.169962 Sep 14 12:15:58.746260 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 485/973] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:58 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:15:59.773979 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:15:59.774623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:15:59.781088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:59.781575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:59.782062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:59.782757 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:15:59.783213 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:15:59.783642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:15:59.915168 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:59.923235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:59.924682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:15:59.926401 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6cba93a0-4b9f-46b2-91e1-1ec859fa6bda tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.157265 Sep 14 12:15:59.926971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 489/974] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:15:59 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:16:00.952662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:00.953270 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:00.960877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:00.961366 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:00.961806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:00.962547 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:00.963003 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:00.963439 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:01.114465 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:01.123295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:01.124742 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:01.125951 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a66edec7-f5c7-4d04-83d8-159e3043a1cd tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.177418 Sep 14 12:16:01.126526 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 486/975] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:00 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:02.152085 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:02.152689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:02.160018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:02.160478 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:02.160935 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:02.161629 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:02.162101 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:02.162525 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:02.299235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:02.308347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:02.309805 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:02.311002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cf37e552-f9c2-40df-a3b0-d67b59acc176 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.163145 Sep 14 12:16:02.311561 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 490/976] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:02 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:03.337014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:03.337632 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:03.344869 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:03.345983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:03.345983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:03.346533 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:03.346992 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:03.347443 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:03.503138 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:03.510710 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:03.512028 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:03.513214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2a1a62da-a076-4598-9e9d-c0567e9a883e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.180363 Sep 14 12:16:03.513788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 487/977] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:03 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:04.540764 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:04.541402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:04.548182 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:04.548708 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:04.549150 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:04.549852 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:04.550906 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:04.551332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:04.690531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:04.698817 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:04.700241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:04.701392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-060606fb-343b-4135-8060-327a54b18d66 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.165636 Sep 14 12:16:04.701978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 491/978] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:04 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:05.727016 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:05.727702 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:05.734309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:05.734797 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:05.735241 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:05.735934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:05.736383 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:05.736810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:05.875986 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:05.884359 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:05.885837 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:05.887066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7f3c4a4b-302f-4807-abee-8fbfe4a5efc6 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.163987 Sep 14 12:16:05.887631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 488/979] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:05 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:16:06.915969 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:06.916779 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:06.923520 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:06.924011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:06.924452 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:06.925664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:06.926148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:06.926571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:07.062475 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:07.071553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:07.073002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:07.074192 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-58db46fc-2288-4c06-88e5-137d762e4f5e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.164336 Sep 14 12:16:07.074762 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 492/980] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:06 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:08.240477 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:08.241094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:08.247125 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:08.247619 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:08.248056 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:08.248897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:08.249352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:08.249800 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:08.405042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:08.413929 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:08.415413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:08.416603 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-65332b82-3d10-4be0-b25f-f694091bc505 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.321045 Sep 14 12:16:08.417170 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 489/981] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:08 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:09.442402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:09.443025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:09.449810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:09.450330 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:09.450767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:09.451457 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:09.451913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:09.452329 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:09.616296 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:09.625504 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:09.627121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:09.628813 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bee0e5f0-c67b-4b25-ae59-f80ff6bbe82e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.190035 Sep 14 12:16:09.629392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 493/982] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:09 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:10.658031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:10.658668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:10.665975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:10.666473 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:10.666939 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:10.667621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:10.668086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:10.668517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:10.836185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:10.845132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:10.846623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:10.848366 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1095ba8f-bd45-4ee7-8bd7-acd512e2d69e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.194411 Sep 14 12:16:10.848931 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 490/983] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:10 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:11.872988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:11.873597 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:11.881009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:11.881544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:11.882022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:11.882717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:11.883174 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:11.883606 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:12.172899 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:12.181884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:12.183421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:12.184632 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-05fdc354-8010-4fe7-a292-6e3aa067c5cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.315777 Sep 14 12:16:12.185303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 494/984] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:11 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:13.215671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:13.216379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:13.219182 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=25 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:13.224896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:13.225387 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:13.225838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:13.226830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:13.227300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:13.227736 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:13.230341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=71 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:13.371626 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:13.381088 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:13.382574 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:13.383745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2f399c4e-1862-4415-97de-740a5ead3f2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.175426 Sep 14 12:16:13.384311 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 491/985] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:13 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:14.411187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:14.411811 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:14.418425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:14.418912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:14.419447 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:14.420063 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:14.420521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:14.420970 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:14.460402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-fc6e26b5-a7bf-4dad-9fbb-e692d67f01f5 req-9440970c-b07d-440c-8dcd-1785d1709518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8a5c35-addb-48f1-928a-c53c742fbe4c", "name": "network-vif-plugged", "status": "completed", "tag": "bfea540b-fd0e-472b-8c6b-76b61ec6c980"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:16:14.473592 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-fc6e26b5-a7bf-4dad-9fbb-e692d67f01f5 req-9440970c-b07d-440c-8dcd-1785d1709518 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:14.474487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-fc6e26b5-a7bf-4dad-9fbb-e692d67f01f5 req-9440970c-b07d-440c-8dcd-1785d1709518 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:14.480460 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-fc6e26b5-a7bf-4dad-9fbb-e692d67f01f5 req-9440970c-b07d-440c-8dcd-1785d1709518 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:14.487324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-fc6e26b5-a7bf-4dad-9fbb-e692d67f01f5 req-9440970c-b07d-440c-8dcd-1785d1709518 service nova] Creating event network-vif-plugged:bfea540b-fd0e-472b-8c6b-76b61ec6c980 for instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c on hv-cinder-84496 Sep 14 12:16:14.493901 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-fc6e26b5-a7bf-4dad-9fbb-e692d67f01f5 req-9440970c-b07d-440c-8dcd-1785d1709518 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038314 Sep 14 12:16:14.494553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 492/986] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:16:14.606704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:14.615616 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:14.617104 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:14.618320 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c8043c43-ffe2-47e7-8d76-31628e69122c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.211994 Sep 14 12:16:14.618900 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 495/987] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:14 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:15.647418 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:15.648660 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:15.654876 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:15.655371 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:15.655814 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:15.656516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:15.656972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:15.657404 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:15.816350 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:15.828515 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:15.828682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:15.830178 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1b8a5401-a7b4-4539-8dbd-8f54f5d8d3cf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1742 microversion: 2.20 time: 0.189147 Sep 14 12:16:15.830848 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 493/988] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:15 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1742 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:16.856714 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:16.857417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:16.859756 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=27 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:16.864803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:16.865290 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:16.865717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:16.866444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:16.866892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:16.867310 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:16.871493 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:17.020886 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:17.029376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:17.030856 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:17.032022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bdd55ab0-5926-4583-8d42-58a0c70953f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.179247 Sep 14 12:16:17.032576 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 496/989] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:16 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:18.059231 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:18.062181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:18.068275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:18.068769 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:18.069235 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:18.069983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:18.070441 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:18.071182 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:18.244360 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:18.254677 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:18.256154 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:18.257333 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-73e435f0-726f-419a-ae8c-a767ddc619f4 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.203175 Sep 14 12:16:18.257916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 494/990] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:18 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:19.293008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:19.293008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:19.297012 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:19.297724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:19.298370 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:19.299232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:19.299693 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:19.300139 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:19.465326 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:19.478456 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:19.480300 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:19.482584 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5c41efc0-a4cb-4970-959d-168ad2d46601 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.198932 Sep 14 12:16:19.483577 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 497/991] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:19 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:20.521604 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:20.522375 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:20.530992 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:20.533050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:20.533630 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:20.535047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:20.535579 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:20.536243 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:20.715464 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:20.726956 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:20.728860 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:20.730216 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f0e5f64e-a477-4f29-a7e2-c1aefb9a5583 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.212966 Sep 14 12:16:20.731209 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 495/992] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:20 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:21.757165 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:21.757775 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:21.766181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:21.766754 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:21.767217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:21.768024 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:21.768512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:21.769024 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:21.946562 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:21.957255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:21.958761 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:21.959942 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b1c110a8-0c88-4749-8951-a302102dc26c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.207506 Sep 14 12:16:21.960534 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 498/993] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:21 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:22.991119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:22.991981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:22.998427 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:22.999129 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:22.999816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:23.000817 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:23.001288 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:23.001723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:23.169179 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:23.178399 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:23.179853 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:23.181040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a6585064-0549-4391-9d6b-d3dd70980d2c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.197407 Sep 14 12:16:23.181679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 496/994] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:22 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:24.208579 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:24.210156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:24.217510 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:24.218394 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:24.223803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:24.223803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:24.223803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:24.223803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:24.439339 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:24.448444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:24.449954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:24.451139 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-476d63fc-6bd0-4e25-aa12-177eec558b37 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.247312 Sep 14 12:16:24.451698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 499/995] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:24 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:25.480684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:25.482436 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:25.491176 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:25.492575 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:25.493210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:25.494319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:25.494869 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:25.495372 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:25.701223 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:25.710842 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:25.712410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:25.713798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-22baec2d-7e5b-48fd-8867-52e440f18e01 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.238696 Sep 14 12:16:25.725909 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 497/996] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:25 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:16:26.753077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:26.753653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:26.769389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:26.770142 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:26.770729 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:26.771679 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:26.772279 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:26.772892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:26.957318 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:26.970779 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:26.971793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:26.972999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-84e917dd-da5f-465f-934c-47c136ae6bdc tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.224228 Sep 14 12:16:26.975725 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 500/997] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:26 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:28.007383 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:28.008053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:28.015009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:28.015560 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:28.016656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:28.017541 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:28.018197 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:28.018943 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:28.228580 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:28.243054 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:28.244799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:28.247102 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-205825e1-380c-457b-8417-e296993df826 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.243934 Sep 14 12:16:28.262003 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 498/998] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:28 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:29.292210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:29.293454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:29.304834 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:29.305606 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:29.306297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:29.307462 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:29.308157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:29.308751 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:29.453756 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:29.462322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:29.463773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:29.464948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-db4c1d66-7325-41db-a3d1-0114ef5e6a97 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.180193 Sep 14 12:16:29.465520 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 501/999] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:29 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:30.492597 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:30.493966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:30.501188 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:30.501768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:30.502344 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:30.503509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:30.504476 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:30.504987 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:30.697844 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:30.706873 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:30.708314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:30.709480 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f7216069-2d09-42c5-81e4-9317c9fa3d7f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.220940 Sep 14 12:16:30.710124 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 499/1000] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:30 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:31.744547 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:31.745369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:31.752265 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:31.753512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:31.754091 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:31.754898 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:31.755442 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:31.755954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:31.914423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:31.923200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:31.925222 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:31.926759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-21fbb60d-9322-4c60-9190-cf3640e6ffdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1737 microversion: 2.20 time: 0.186342 Sep 14 12:16:31.927386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 502/1001] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:31 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:16:32.957705 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:32.957705 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:32.963898 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:32.964711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:32.965248 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:32.965993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:32.966457 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:32.967044 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:33.176230 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:33.184638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:33.186258 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:33.187433 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-062298a2-996c-4f1a-9f60-11e342122d71 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1719 microversion: 2.20 time: 0.235480 Sep 14 12:16:33.187997 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 500/1002] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:32 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1719 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:34.214220 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:34.214843 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:34.221318 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:34.222597 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:34.223172 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:34.223802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:34.224265 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:34.224696 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:34.362838 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:34.371237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:34.372673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:34.373851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a207cf19-4ee1-4a9d-801d-c4abbdb7081e tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1719 microversion: 2.20 time: 0.163629 Sep 14 12:16:34.374635 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 503/1003] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:34 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:34.428085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-d735d788-d252-442d-a50f-2288f92d3fbd req-2c468d40-20ad-4b16-bfba-a681caf43558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8a5c35-addb-48f1-928a-c53c742fbe4c", "name": "network-vif-unplugged", "status": "completed", "tag": "bfea540b-fd0e-472b-8c6b-76b61ec6c980"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:16:34.438170 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d735d788-d252-442d-a50f-2288f92d3fbd req-2c468d40-20ad-4b16-bfba-a681caf43558 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:34.438659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d735d788-d252-442d-a50f-2288f92d3fbd req-2c468d40-20ad-4b16-bfba-a681caf43558 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:34.439096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-d735d788-d252-442d-a50f-2288f92d3fbd req-2c468d40-20ad-4b16-bfba-a681caf43558 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:34.453358 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-d735d788-d252-442d-a50f-2288f92d3fbd req-2c468d40-20ad-4b16-bfba-a681caf43558 service nova] Creating event network-vif-unplugged:bfea540b-fd0e-472b-8c6b-76b61ec6c980 for instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c on hv-cinder-84496 Sep 14 12:16:34.459058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-d735d788-d252-442d-a50f-2288f92d3fbd req-2c468d40-20ad-4b16-bfba-a681caf43558 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034776 Sep 14 12:16:34.459721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 501/1004] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:16:35.400175 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:35.400814 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:35.407605 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:35.408052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:35.408499 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:35.409711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:35.410198 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:35.410642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:35.544214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:35.553017 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:35.554508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:35.555660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-75f4ede1-73ff-48fe-9848-dcbed4d4818c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1719 microversion: 2.20 time: 0.159909 Sep 14 12:16:35.556247 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 504/1005] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:35 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:36.583569 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:36.584268 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:36.590488 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:36.590976 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:36.591419 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:36.592108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:36.592563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:36.592991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:36.736687 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:36.747005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:36.750936 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:36.750936 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-64d51d1e-2f8d-4dbd-8ae4-5e19d26d5365 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1662 microversion: 2.20 time: 0.170839 Sep 14 12:16:36.750936 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 502/1006] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:36 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:36.774592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1a021bd4-ed61-4c49-a69b-13f3911aae3f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0568671f-4392-4250-a539-3066e5bee48e"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:16:36.776970 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1a021bd4-ed61-4c49-a69b-13f3911aae3f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:36.784003 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1a021bd4-ed61-4c49-a69b-13f3911aae3f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:36.785037 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1a021bd4-ed61-4c49-a69b-13f3911aae3f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:36.785476 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1a021bd4-ed61-4c49-a69b-13f3911aae3f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:36.786216 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1a021bd4-ed61-4c49-a69b-13f3911aae3f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:36.786671 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1a021bd4-ed61-4c49-a69b-13f3911aae3f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:36.787093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1a021bd4-ed61-4c49-a69b-13f3911aae3f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:37.907228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1a021bd4-ed61-4c49-a69b-13f3911aae3f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "POST /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.136794 Sep 14 12:16:37.908003 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 505/1007] 10.222.0.62 () {62 vars in 1364 bytes} [Wed Sep 14 12:16:36 2022] POST /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/os-volume_attachments => generated 188 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 12:16:38.043318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d4c1b379-47bf-4eee-acb7-a8711c625856 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:38.044791 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d4c1b379-47bf-4eee-acb7-a8711c625856 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:38.051330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4c1b379-47bf-4eee-acb7-a8711c625856 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:38.051846 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4c1b379-47bf-4eee-acb7-a8711c625856 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:38.052285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4c1b379-47bf-4eee-acb7-a8711c625856 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:38.053012 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4c1b379-47bf-4eee-acb7-a8711c625856 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:38.053410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4c1b379-47bf-4eee-acb7-a8711c625856 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:38.053996 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4c1b379-47bf-4eee-acb7-a8711c625856 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:38.695158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d4c1b379-47bf-4eee-acb7-a8711c625856 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/os-volume_attachments/0568671f-4392-4250-a539-3066e5bee48e" status: 202 len: 0 microversion: 2.20 time: 0.655798 Sep 14 12:16:38.696001 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 503/1008] 10.222.0.62 () {60 vars in 1457 bytes} [Wed Sep 14 12:16:38 2022] DELETE /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/os-volume_attachments/0568671f-4392-4250-a539-3066e5bee48e => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 14 12:16:38.772347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1dadf42c-d408-4ac5-990c-f6802596ccca tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:16:38.774855 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1dadf42c-d408-4ac5-990c-f6802596ccca tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:38.779749 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dadf42c-d408-4ac5-990c-f6802596ccca tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:38.780237 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dadf42c-d408-4ac5-990c-f6802596ccca tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:38.780706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dadf42c-d408-4ac5-990c-f6802596ccca tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:38.781486 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dadf42c-d408-4ac5-990c-f6802596ccca tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:38.781981 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dadf42c-d408-4ac5-990c-f6802596ccca tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:38.782410 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dadf42c-d408-4ac5-990c-f6802596ccca tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:38.814941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1dadf42c-d408-4ac5-990c-f6802596ccca tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121152) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 12:16:39.113520 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1dadf42c-d408-4ac5-990c-f6802596ccca tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "POST /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/action" status: 202 len: 0 microversion: 2.20 time: 0.345559 Sep 14 12:16:39.114410 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 506/1009] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Sep 14 12:16:38 2022] POST /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:16:39.124399 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:39.124920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:39.132799 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:39.133280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:39.133823 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:39.139076 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:39.139076 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:39.139076 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:39.317189 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:39.331318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:39.334087 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:39.336068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2394103a-578a-4f39-84c8-08246b509209 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1670 microversion: 2.20 time: 0.216725 Sep 14 12:16:39.337024 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 504/1010] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:39 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:40.365939 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:40.368368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:40.377647 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:40.378316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:40.378805 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:40.379625 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:40.380146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:40.380673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:40.553596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:40.563902 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:40.565359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:40.567386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4411c20b-bb37-402e-b977-de3f25e9f438 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1670 microversion: 2.20 time: 0.207495 Sep 14 12:16:40.567961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 507/1011] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:40 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1670 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:41.595097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:41.595880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:41.603913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:41.604328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:41.605553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:41.605553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:41.605967 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:41.606413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:41.774981 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:41.782091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:41.785162 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:41.786416 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b8876819-168d-4395-8913-f7ac06c8b543 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.196204 Sep 14 12:16:41.786984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 505/1012] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:41 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:42.815388 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:42.816011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:42.828379 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:42.828881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:42.829317 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:42.830241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:42.831245 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:42.831684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:42.976846 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:42.985264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:42.986739 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:42.987892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5490f8e5-41ef-487b-87e3-9f93bdc7780a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.176587 Sep 14 12:16:42.988442 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 508/1013] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:42 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:44.017252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:44.017849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:44.020535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=30 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:44.026328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:44.027278 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:44.027278 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:44.027856 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:44.028322 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:44.028757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:44.034709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:44.186606 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:44.194996 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:44.196515 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:44.197670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cbc889bc-b74c-43ad-9b2d-f4959f3f8497 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.187299 Sep 14 12:16:44.198289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 506/1014] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:44 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:16:45.224781 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:45.225463 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:45.232187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:45.232686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:45.233882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:45.233882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:45.234302 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:45.234738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:45.237601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:45.381569 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:45.390349 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:45.391806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:45.393006 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9d8d2fd2-3ead-42cf-ae26-e44933fde147 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.172969 Sep 14 12:16:45.394096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 509/1015] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:45 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:16:46.420836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:46.421535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:46.429281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:46.429776 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:46.430236 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:46.430945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:46.431393 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:46.431815 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:46.581808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:46.591115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:46.592719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:46.594150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-70a78a4b-43d6-49c8-ad84-2eadc372a4a3 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.178222 Sep 14 12:16:46.608221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 507/1016] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:46 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:47.627173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:47.628475 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:47.631400 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:47.637202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:47.638034 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:47.638539 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:47.639420 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:47.640129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:47.640556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:48.106246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:48.109431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:48.115544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:48.116739 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c981fcd2-599e-4f23-a8d4-70f9d4539741 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.500257 Sep 14 12:16:48.117307 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 510/1017] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:47 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:49.144895 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:49.145821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:49.157614 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:49.161395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:49.161395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:49.161395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:49.161395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:49.161912 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:49.351240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:49.360108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:49.362286 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:49.370542 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-63b30a58-240c-4113-9a0c-bc0c967ecc44 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.231581 Sep 14 12:16:49.371128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 508/1018] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:49 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:50.397764 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:50.398685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:50.407097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:50.407836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:50.408773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:50.410458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:50.411090 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:50.411683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:50.576273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:50.591180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:50.592916 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:50.594188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7d2280a0-45b9-438b-8ab7-f651dcb165d9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.200788 Sep 14 12:16:50.594754 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 511/1019] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:50 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:51.623994 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:51.624704 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:51.631888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:51.632510 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:51.633043 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:51.633885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:51.634437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:51.635095 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:51.901451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:51.913315 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:51.914834 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:51.916080 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b1f8a95f-3eb7-419b-9640-ccfbbe5bc969 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.296185 Sep 14 12:16:51.916657 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 509/1020] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:51 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:52.942897 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:52.943854 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:52.950858 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:52.951371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:52.951796 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:52.952484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:52.952934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:52.953352 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:53.149305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:53.158149 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:53.159862 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:53.161220 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d522b165-af85-43b9-a423-26c7a5813fc8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.223006 Sep 14 12:16:53.163021 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 512/1021] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:52 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:53.695869 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f2860849-2717-4c94-83f0-386e62cdc0a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:53.696453 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f2860849-2717-4c94-83f0-386e62cdc0a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:53.704125 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f2860849-2717-4c94-83f0-386e62cdc0a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:53.704640 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f2860849-2717-4c94-83f0-386e62cdc0a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:53.705064 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f2860849-2717-4c94-83f0-386e62cdc0a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:53.705819 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f2860849-2717-4c94-83f0-386e62cdc0a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:53.706511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f2860849-2717-4c94-83f0-386e62cdc0a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:53.710411 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f2860849-2717-4c94-83f0-386e62cdc0a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:53.743304 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f2860849-2717-4c94-83f0-386e62cdc0a3 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/ips" status: 200 len: 146 microversion: 2.1 time: 0.308660 Sep 14 12:16:53.744699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 510/1022] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 14 12:16:53 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/ips => generated 146 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:16:54.188878 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:54.189523 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:54.195782 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:54.196270 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:54.196704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:54.197396 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:54.197917 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:54.198373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:54.335481 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:54.344391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:54.346187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:54.348163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f5d9ed8d-f962-44bf-a32c-c972ce0927fb tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.163271 Sep 14 12:16:54.348748 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 513/1023] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:54 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:55.375871 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:55.376475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:55.383107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:55.383598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:55.383980 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:55.384681 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:55.385128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:55.385624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:55.526132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:55.535034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:55.536530 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:55.537712 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a73b72fb-87a2-43b7-8648-044759c56de9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.165880 Sep 14 12:16:55.538327 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 511/1024] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:55 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:56.564721 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:56.565327 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:56.572641 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:56.573125 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:56.573627 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:56.574460 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:56.574914 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:56.575339 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:56.711134 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:56.719926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:56.721374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:56.722599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-18c7c6d0-52b5-4fbe-9f9e-94e9be6ae139 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.163043 Sep 14 12:16:56.723155 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 514/1025] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:56 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:56.787237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-578e4ee8-5f2f-4dda-bd74-a35c716dbaae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90a5577a-450d-498b-8c22-0b67c3983b1a"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:16:56.789724 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-578e4ee8-5f2f-4dda-bd74-a35c716dbaae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:56.796413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-578e4ee8-5f2f-4dda-bd74-a35c716dbaae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:56.796922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-578e4ee8-5f2f-4dda-bd74-a35c716dbaae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:56.797340 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-578e4ee8-5f2f-4dda-bd74-a35c716dbaae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:56.798068 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-578e4ee8-5f2f-4dda-bd74-a35c716dbaae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:56.798527 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-578e4ee8-5f2f-4dda-bd74-a35c716dbaae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:56.798966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-578e4ee8-5f2f-4dda-bd74-a35c716dbaae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:57.749163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:57.749949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:57.756515 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:57.760078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:57.760078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:57.760078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:57.760078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:57.760513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:57.892320 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:57.901825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:57.903484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:57.904772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f0e7498b-f77e-4dc3-ab76-6396ccf1f89c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.160153 Sep 14 12:16:57.905346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 515/1026] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:57 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:16:58.932191 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:16:58.932905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:16:58.939591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:58.940079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:58.941160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:58.941879 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:16:58.942337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:16:58.942758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:16:59.082586 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:59.090831 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:59.092341 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:16:59.093514 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-430eb406-84eb-4fd9-95fc-789cab33764c tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.165289 Sep 14 12:16:59.094105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 516/1027] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:16:58 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:17:00.119925 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:00.120606 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:00.127293 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:00.128304 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:00.128706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:00.129396 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:00.129842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:00.130282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:00.290182 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:00.299069 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:00.301152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:00.302533 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-92addc69-1c66-40c8-8ccf-8d962695ef2d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.186563 Sep 14 12:17:00.303488 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 517/1028] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:17:00 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:17:01.194280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-578e4ee8-5f2f-4dda-bd74-a35c716dbaae tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.408752 Sep 14 12:17:01.194280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 512/1029] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:16:56 2022] POST /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments => generated 194 bytes in 4410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:01.328417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:01.329025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:01.335991 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:01.336475 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:01.336905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:01.337658 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:01.338134 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:01.338554 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:01.501492 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:01.516315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:01.519684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:01.521703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b4d609ce-9b24-4ac7-954c-795fdba34c23 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.197021 Sep 14 12:17:01.522665 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 518/1030] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:17:01 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:17:02.504804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9b8caa89-7f6b-4510-8c2c-19ace8489d8d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:02.505410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9b8caa89-7f6b-4510-8c2c-19ace8489d8d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:02.511764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8caa89-7f6b-4510-8c2c-19ace8489d8d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:02.512258 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8caa89-7f6b-4510-8c2c-19ace8489d8d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:02.512699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8caa89-7f6b-4510-8c2c-19ace8489d8d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:02.513403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8caa89-7f6b-4510-8c2c-19ace8489d8d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:02.513893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8caa89-7f6b-4510-8c2c-19ace8489d8d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:02.514313 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8caa89-7f6b-4510-8c2c-19ace8489d8d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:02.539569 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9b8caa89-7f6b-4510-8c2c-19ace8489d8d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/ips" status: 200 len: 149 microversion: 2.1 time: 0.040005 Sep 14 12:17:02.540157 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 513/1031] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 14 12:17:02 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:02.551608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:02.552228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:02.559255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:02.559747 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:02.560821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:02.561516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:02.562159 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:02.562740 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:02.704400 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:02.712611 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:02.714083 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:02.715290 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d714a3e2-f791-418c-bb58-75f747354868 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.168355 Sep 14 12:17:02.715850 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 519/1032] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:17:02 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:17:03.740892 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:03.741539 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:03.747959 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:03.751198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:03.751198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:03.751198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:03.751198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:03.751603 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:03.883300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:03.891495 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:03.893060 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:03.894849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5d877168-9d36-44e7-8069-192ba39d6bfe tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.157992 Sep 14 12:17:03.895413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 514/1033] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:17:03 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:17:04.730598 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-f65218be-6fb2-44bd-a06d-8d121703849f req-de2b441c-0aa7-4e52-bc8a-50c2365576b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8a5c35-addb-48f1-928a-c53c742fbe4c", "name": "network-vif-plugged", "status": "completed", "tag": "bfea540b-fd0e-472b-8c6b-76b61ec6c980"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:17:04.741511 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-f65218be-6fb2-44bd-a06d-8d121703849f req-de2b441c-0aa7-4e52-bc8a-50c2365576b0 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:04.742040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-f65218be-6fb2-44bd-a06d-8d121703849f req-de2b441c-0aa7-4e52-bc8a-50c2365576b0 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:04.742464 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-f65218be-6fb2-44bd-a06d-8d121703849f req-de2b441c-0aa7-4e52-bc8a-50c2365576b0 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:04.754598 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-f65218be-6fb2-44bd-a06d-8d121703849f req-de2b441c-0aa7-4e52-bc8a-50c2365576b0 service nova] Creating event network-vif-plugged:bfea540b-fd0e-472b-8c6b-76b61ec6c980 for instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c on hv-cinder-84496 Sep 14 12:17:04.759774 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-f65218be-6fb2-44bd-a06d-8d121703849f req-de2b441c-0aa7-4e52-bc8a-50c2365576b0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156867 Sep 14 12:17:04.760383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 520/1034] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:04.920722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:04.921324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:04.928310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:04.928803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:04.929246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:04.929975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:04.930435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:04.930878 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:05.072145 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:05.081583 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:05.083160 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:05.084366 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a2e70e31-fb7e-4549-ba5a-fca165e6e71a tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.167703 Sep 14 12:17:05.084936 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 515/1035] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:17:04 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:17:05.405251 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-70e67751-11ba-46b7-a79d-e33f6f3b19c4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3855a0eb-80a4-46cc-af8e-0f852fa78e8d"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:17:05.407741 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-70e67751-11ba-46b7-a79d-e33f6f3b19c4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:05.415228 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-70e67751-11ba-46b7-a79d-e33f6f3b19c4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:05.416048 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-70e67751-11ba-46b7-a79d-e33f6f3b19c4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:05.416484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-70e67751-11ba-46b7-a79d-e33f6f3b19c4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:05.417367 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-70e67751-11ba-46b7-a79d-e33f6f3b19c4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:05.417769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-70e67751-11ba-46b7-a79d-e33f6f3b19c4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:05.418273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-70e67751-11ba-46b7-a79d-e33f6f3b19c4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:06.111149 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:06.111700 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:06.118072 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:06.118559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:06.119061 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:06.119750 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:06.120274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:06.120703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:06.263417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:06.272028 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:06.273941 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:06.275451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7e0aaf80-59ea-4a33-97c8-e22a765f2848 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.168627 Sep 14 12:17:06.276287 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 516/1036] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:17:06 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 12:17:06.705467 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-70e67751-11ba-46b7-a79d-e33f6f3b19c4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.304563 Sep 14 12:17:06.706339 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 521/1037] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:17:05 2022] POST /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 194 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:07.303872 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:07.305208 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:07.311873 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:07.312373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:07.312859 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:07.314020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:07.314482 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:07.314914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:07.461081 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:07.469344 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:07.471119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:07.472309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-67cb147f-4604-4210-a7ad-b0345267fd26 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.174600 Sep 14 12:17:07.474890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 517/1038] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:17:07 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:17:08.508835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:08.510286 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:08.520635 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:08.521537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:08.522242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:08.523451 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:08.524203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:08.525105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:08.668987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:08.677621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:08.679376 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:08.680561 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c57e8a96-eb85-43ff-a542-307db169a93d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1728 microversion: 2.20 time: 0.177277 Sep 14 12:17:08.681214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 522/1039] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:17:08 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:17:09.707360 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:09.707902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:09.714412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:09.717032 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:09.717032 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:09.717032 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:09.717032 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:09.717453 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:09.865101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:09.874999 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:09.877041 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:09.877723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3c4f8c6c-ba40-4698-abdd-65ffc65ba457 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1715 microversion: 2.20 time: 0.174819 Sep 14 12:17:09.878385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 518/1040] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:17:09 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1715 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:17:10.079087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6f1e8546-7c88-4395-960c-66d994eb9314 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:10.086028 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6f1e8546-7c88-4395-960c-66d994eb9314 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:10.088704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6f1e8546-7c88-4395-960c-66d994eb9314 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:10.089191 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6f1e8546-7c88-4395-960c-66d994eb9314 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:10.089634 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6f1e8546-7c88-4395-960c-66d994eb9314 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:10.090406 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6f1e8546-7c88-4395-960c-66d994eb9314 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:10.090866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6f1e8546-7c88-4395-960c-66d994eb9314 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:10.091294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6f1e8546-7c88-4395-960c-66d994eb9314 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:10.122176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6f1e8546-7c88-4395-960c-66d994eb9314 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047075 Sep 14 12:17:10.122734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 523/1041] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:10 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:10.133658 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f98d3e63-d24b-408b-ad46-c9bc4fe5741b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:10.134209 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f98d3e63-d24b-408b-ad46-c9bc4fe5741b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:10.140175 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98d3e63-d24b-408b-ad46-c9bc4fe5741b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:10.140669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98d3e63-d24b-408b-ad46-c9bc4fe5741b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:10.141115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98d3e63-d24b-408b-ad46-c9bc4fe5741b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:10.141877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98d3e63-d24b-408b-ad46-c9bc4fe5741b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:10.142341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98d3e63-d24b-408b-ad46-c9bc4fe5741b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:10.142775 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98d3e63-d24b-408b-ad46-c9bc4fe5741b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:10.174113 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f98d3e63-d24b-408b-ad46-c9bc4fe5741b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments/90a5577a-450d-498b-8c22-0b67c3983b1a" status: 200 len: 194 microversion: 2.1 time: 0.044331 Sep 14 12:17:10.174901 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 519/1042] 10.222.0.62 () {58 vars in 1413 bytes} [Wed Sep 14 12:17:10 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments/90a5577a-450d-498b-8c22-0b67c3983b1a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:17:12.899357 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-876b5cb9-26f0-4870-88f3-84d78f2a7efa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4f7a3fc-2e39-4bcb-a1c9-9f126b1a9013"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:17:12.901769 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-876b5cb9-26f0-4870-88f3-84d78f2a7efa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:12.908349 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-876b5cb9-26f0-4870-88f3-84d78f2a7efa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:12.908826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-876b5cb9-26f0-4870-88f3-84d78f2a7efa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:12.909393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-876b5cb9-26f0-4870-88f3-84d78f2a7efa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:12.910057 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-876b5cb9-26f0-4870-88f3-84d78f2a7efa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:12.910595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-876b5cb9-26f0-4870-88f3-84d78f2a7efa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:12.910885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-876b5cb9-26f0-4870-88f3-84d78f2a7efa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:13.130902 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:13.705030 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-876b5cb9-26f0-4870-88f3-84d78f2a7efa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "POST /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810313 Sep 14 12:17:13.705585 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 524/1043] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:17:12 2022] POST /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:17.535536 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3855a0eb-80a4-46cc-af8e-0f852fa78e8d"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:17:17.537993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:17.540422 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=28 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:17.545610 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:17.546114 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:17.546548 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:17.547234 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:17.547684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:17.548106 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:17.551740 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:17.631985 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Invalid volume: volume 3855a0eb-80a4-46cc-af8e-0f852fa78e8d is already attached to instances: a6bf2654-f27a-4ec4-9dba-d70e557034df Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: POST /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments HTTP/1.1 Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 74 Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:17:17.641893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {"volumeAttachment": {"volumeId": "3855a0eb-80a4-46cc-af8e-0f852fa78e8d"}} Sep 14 12:17:17.643770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Invalid volume: volume 3855a0eb-80a4-46cc-af8e-0f852fa78e8d is already attached to instances: a6bf2654-f27a-4ec4-9dba-d70e557034df Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'server_id': 'a6bf2654-f27a-4ec4-9dba-d70e557034df', 'body': {'volumeAttachment': {'volumeId': '3855a0eb-80a4-46cc-af8e-0f852fa78e8d'}}} Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3855a0eb-80a4-46cc-af8e-0f852fa78e8d is already attached to instances: a6bf2654-f27a-4ec4-9dba-d70e557034df Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:17.644793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3855a0eb-80a4-46cc-af8e-0f852fa78e8d is already attached to instances: a6bf2654-f27a-4ec4-9dba-d70e557034df Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:17.647330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:17.649385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:17.649385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:17:17.649385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:17:17.649385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3855a0eb-80a4-46cc-af8e-0f852fa78e8d is already attached to instances: a6bf2654-f27a-4ec4-9dba-d70e557034df Sep 14 12:17:17.649385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:17.649385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 400 to user: Invalid volume: volume 3855a0eb-80a4-46cc-af8e-0f852fa78e8d is already attached to instances: a6bf2654-f27a-4ec4-9dba-d70e557034df {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:17:17.649385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cede80c9-d594-489d-98d4-a19e43d9787d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103630 Sep 14 12:17:17.649385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 520/1044] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:17:17 2022] POST /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 12:17:17.703416 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-228421a7-d1e6-4ef0-9809-1b3d5689ec59 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:17.703997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-228421a7-d1e6-4ef0-9809-1b3d5689ec59 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:17.710868 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-228421a7-d1e6-4ef0-9809-1b3d5689ec59 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:17.711351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-228421a7-d1e6-4ef0-9809-1b3d5689ec59 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:17.711786 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-228421a7-d1e6-4ef0-9809-1b3d5689ec59 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:17.712470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-228421a7-d1e6-4ef0-9809-1b3d5689ec59 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:17.712922 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-228421a7-d1e6-4ef0-9809-1b3d5689ec59 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:17.713351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-228421a7-d1e6-4ef0-9809-1b3d5689ec59 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:17.797458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-228421a7-d1e6-4ef0-9809-1b3d5689ec59 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lazy-loading 'services' on Instance uuid a6bf2654-f27a-4ec4-9dba-d70e557034df {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:17:18.064805 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-228421a7-d1e6-4ef0-9809-1b3d5689ec59 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments/3855a0eb-80a4-46cc-af8e-0f852fa78e8d" status: 202 len: 0 microversion: 2.1 time: 0.361158 Sep 14 12:17:18.064805 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 525/1045] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:17:17 2022] DELETE /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments/3855a0eb-80a4-46cc-af8e-0f852fa78e8d => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:17:18.073138 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0b60f4eb-6574-4e9d-a9d0-3ca2933b613e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:18.075667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0b60f4eb-6574-4e9d-a9d0-3ca2933b613e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:18.084985 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b60f4eb-6574-4e9d-a9d0-3ca2933b613e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:18.085583 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b60f4eb-6574-4e9d-a9d0-3ca2933b613e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:18.086130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b60f4eb-6574-4e9d-a9d0-3ca2933b613e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:18.086836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b60f4eb-6574-4e9d-a9d0-3ca2933b613e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:18.087294 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b60f4eb-6574-4e9d-a9d0-3ca2933b613e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:18.087719 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0b60f4eb-6574-4e9d-a9d0-3ca2933b613e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:18.124132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0b60f4eb-6574-4e9d-a9d0-3ca2933b613e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050603 Sep 14 12:17:18.124132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 521/1046] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:18 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:19.136919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7bde2bcf-0685-46a4-bddd-c5a6811f7e70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:19.140274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7bde2bcf-0685-46a4-bddd-c5a6811f7e70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:19.146517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=32 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:19.147261 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7bde2bcf-0685-46a4-bddd-c5a6811f7e70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:19.147999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7bde2bcf-0685-46a4-bddd-c5a6811f7e70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:19.148436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7bde2bcf-0685-46a4-bddd-c5a6811f7e70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:19.149131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7bde2bcf-0685-46a4-bddd-c5a6811f7e70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:19.149587 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7bde2bcf-0685-46a4-bddd-c5a6811f7e70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:19.150054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7bde2bcf-0685-46a4-bddd-c5a6811f7e70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:19.180818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7bde2bcf-0685-46a4-bddd-c5a6811f7e70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049704 Sep 14 12:17:19.181400 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 526/1047] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:19 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:20.195356 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c9a4e4e6-9db6-4c4f-b69c-309c28f86197 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:20.197481 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c9a4e4e6-9db6-4c4f-b69c-309c28f86197 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:20.204846 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a4e4e6-9db6-4c4f-b69c-309c28f86197 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:20.205327 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a4e4e6-9db6-4c4f-b69c-309c28f86197 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:20.205756 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a4e4e6-9db6-4c4f-b69c-309c28f86197 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:20.206485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a4e4e6-9db6-4c4f-b69c-309c28f86197 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:20.206935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a4e4e6-9db6-4c4f-b69c-309c28f86197 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:20.207412 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a4e4e6-9db6-4c4f-b69c-309c28f86197 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:20.238374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c9a4e4e6-9db6-4c4f-b69c-309c28f86197 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048908 Sep 14 12:17:20.240953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 522/1048] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:20 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:21.251447 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e303e715-0dae-43b2-879e-c54cc0a1bd14 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:21.253623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e303e715-0dae-43b2-879e-c54cc0a1bd14 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:21.260253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e303e715-0dae-43b2-879e-c54cc0a1bd14 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:21.260734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e303e715-0dae-43b2-879e-c54cc0a1bd14 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:21.261156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e303e715-0dae-43b2-879e-c54cc0a1bd14 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:21.261835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e303e715-0dae-43b2-879e-c54cc0a1bd14 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:21.262311 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e303e715-0dae-43b2-879e-c54cc0a1bd14 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:21.262735 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e303e715-0dae-43b2-879e-c54cc0a1bd14 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:21.291812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e303e715-0dae-43b2-879e-c54cc0a1bd14 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Sep 14 12:17:21.292363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 527/1049] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:21 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:22.306267 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7f6185b2-ce87-4834-a6aa-b54d3dc9d030 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:22.308463 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7f6185b2-ce87-4834-a6aa-b54d3dc9d030 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:22.315062 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f6185b2-ce87-4834-a6aa-b54d3dc9d030 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:22.315593 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f6185b2-ce87-4834-a6aa-b54d3dc9d030 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:22.316022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f6185b2-ce87-4834-a6aa-b54d3dc9d030 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:22.316703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f6185b2-ce87-4834-a6aa-b54d3dc9d030 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:22.317151 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f6185b2-ce87-4834-a6aa-b54d3dc9d030 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:22.317573 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f6185b2-ce87-4834-a6aa-b54d3dc9d030 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:22.347425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7f6185b2-ce87-4834-a6aa-b54d3dc9d030 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Sep 14 12:17:22.347987 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 523/1050] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:22 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:23.359791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1076c298-174b-4ae7-9874-09be392d4095 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:23.362086 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1076c298-174b-4ae7-9874-09be392d4095 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:23.368495 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1076c298-174b-4ae7-9874-09be392d4095 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:23.368970 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1076c298-174b-4ae7-9874-09be392d4095 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:23.369397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1076c298-174b-4ae7-9874-09be392d4095 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:23.370105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1076c298-174b-4ae7-9874-09be392d4095 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:23.370551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1076c298-174b-4ae7-9874-09be392d4095 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:23.370968 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1076c298-174b-4ae7-9874-09be392d4095 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:23.401427 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1076c298-174b-4ae7-9874-09be392d4095 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045603 Sep 14 12:17:23.402024 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 528/1051] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:23 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:24.414120 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-542d9746-3876-43ff-bce3-e571558b93bc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:24.416675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-542d9746-3876-43ff-bce3-e571558b93bc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:24.422792 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542d9746-3876-43ff-bce3-e571558b93bc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:24.423281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542d9746-3876-43ff-bce3-e571558b93bc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:24.423721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542d9746-3876-43ff-bce3-e571558b93bc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:24.431053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542d9746-3876-43ff-bce3-e571558b93bc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:24.431053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542d9746-3876-43ff-bce3-e571558b93bc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:24.431053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-542d9746-3876-43ff-bce3-e571558b93bc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:24.457611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-542d9746-3876-43ff-bce3-e571558b93bc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047602 Sep 14 12:17:24.458446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 524/1052] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:24 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:25.473057 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-85d15ce7-f2a7-4727-8400-243e00a2cd6b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:25.476587 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-85d15ce7-f2a7-4727-8400-243e00a2cd6b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:25.486752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85d15ce7-f2a7-4727-8400-243e00a2cd6b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:25.487398 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85d15ce7-f2a7-4727-8400-243e00a2cd6b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:25.487832 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85d15ce7-f2a7-4727-8400-243e00a2cd6b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:25.488557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85d15ce7-f2a7-4727-8400-243e00a2cd6b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:25.489007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85d15ce7-f2a7-4727-8400-243e00a2cd6b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:25.489430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85d15ce7-f2a7-4727-8400-243e00a2cd6b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:25.521640 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-85d15ce7-f2a7-4727-8400-243e00a2cd6b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054802 Sep 14 12:17:25.522264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 529/1053] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:25 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:25.528336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b8dc910b-3031-4ca5-889d-56706030b7f5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:25.530540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b8dc910b-3031-4ca5-889d-56706030b7f5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:25.537125 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8dc910b-3031-4ca5-889d-56706030b7f5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:25.537684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8dc910b-3031-4ca5-889d-56706030b7f5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:25.538258 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8dc910b-3031-4ca5-889d-56706030b7f5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:25.539017 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8dc910b-3031-4ca5-889d-56706030b7f5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:25.539540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8dc910b-3031-4ca5-889d-56706030b7f5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:25.539967 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b8dc910b-3031-4ca5-889d-56706030b7f5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:25.569470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b8dc910b-3031-4ca5-889d-56706030b7f5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045691 Sep 14 12:17:25.570052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 525/1054] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:25 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:25.776354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-15b677bd-38e4-4c7b-828c-9c06fafdb632 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:25.776354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-15b677bd-38e4-4c7b-828c-9c06fafdb632 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:25.776354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15b677bd-38e4-4c7b-828c-9c06fafdb632 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:25.776354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15b677bd-38e4-4c7b-828c-9c06fafdb632 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:25.777066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15b677bd-38e4-4c7b-828c-9c06fafdb632 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:25.777066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15b677bd-38e4-4c7b-828c-9c06fafdb632 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:25.777066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15b677bd-38e4-4c7b-828c-9c06fafdb632 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:25.777066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15b677bd-38e4-4c7b-828c-9c06fafdb632 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:25.777424 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-15b677bd-38e4-4c7b-828c-9c06fafdb632 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments/90a5577a-450d-498b-8c22-0b67c3983b1a" status: 200 len: 194 microversion: 2.1 time: 0.042886 Sep 14 12:17:25.777424 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 530/1055] 10.222.0.62 () {58 vars in 1413 bytes} [Wed Sep 14 12:17:25 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments/90a5577a-450d-498b-8c22-0b67c3983b1a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:25.786926 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b053ee40-8e2e-43d9-bb79-f35e9a597d7e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:25.787459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b053ee40-8e2e-43d9-bb79-f35e9a597d7e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:25.793401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b053ee40-8e2e-43d9-bb79-f35e9a597d7e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:25.793922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b053ee40-8e2e-43d9-bb79-f35e9a597d7e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:25.794367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b053ee40-8e2e-43d9-bb79-f35e9a597d7e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:25.795063 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b053ee40-8e2e-43d9-bb79-f35e9a597d7e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:25.795518 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b053ee40-8e2e-43d9-bb79-f35e9a597d7e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:25.795944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b053ee40-8e2e-43d9-bb79-f35e9a597d7e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:25.879307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-b053ee40-8e2e-43d9-bb79-f35e9a597d7e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lazy-loading 'services' on Instance uuid 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:17:26.124159 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b053ee40-8e2e-43d9-bb79-f35e9a597d7e tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "DELETE /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments/90a5577a-450d-498b-8c22-0b67c3983b1a" status: 202 len: 0 microversion: 2.1 time: 0.341300 Sep 14 12:17:26.124865 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 526/1056] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:17:25 2022] DELETE /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments/90a5577a-450d-498b-8c22-0b67c3983b1a => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:17:26.541819 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2dd4aad9-97de-45ef-bdba-36db655f89e7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:26.543997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2dd4aad9-97de-45ef-bdba-36db655f89e7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:26.550438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dd4aad9-97de-45ef-bdba-36db655f89e7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:26.550914 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dd4aad9-97de-45ef-bdba-36db655f89e7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:26.551343 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dd4aad9-97de-45ef-bdba-36db655f89e7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:26.552029 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dd4aad9-97de-45ef-bdba-36db655f89e7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:26.552475 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dd4aad9-97de-45ef-bdba-36db655f89e7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:26.552893 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2dd4aad9-97de-45ef-bdba-36db655f89e7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:26.582686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2dd4aad9-97de-45ef-bdba-36db655f89e7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045325 Sep 14 12:17:26.583229 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 531/1057] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:26 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 12:17:26.649505 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-62d7c4f3-d0d3-4e42-8a2d-e1ed51d2cdba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:26.650114 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-62d7c4f3-d0d3-4e42-8a2d-e1ed51d2cdba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:26.656529 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f3-d0d3-4e42-8a2d-e1ed51d2cdba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:26.657014 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f3-d0d3-4e42-8a2d-e1ed51d2cdba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:26.657449 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f3-d0d3-4e42-8a2d-e1ed51d2cdba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:26.658171 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f3-d0d3-4e42-8a2d-e1ed51d2cdba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:26.658616 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f3-d0d3-4e42-8a2d-e1ed51d2cdba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:26.659035 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-62d7c4f3-d0d3-4e42-8a2d-e1ed51d2cdba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:26.684390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-62d7c4f3-d0d3-4e42-8a2d-e1ed51d2cdba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:17:26.992410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-62d7c4f3-d0d3-4e42-8a2d-e1ed51d2cdba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 204 len: 0 microversion: 2.1 time: 0.347482 Sep 14 12:17:26.993001 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 527/1058] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:17:26 2022] DELETE /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:17:27.001808 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-aa578c82-e3e0-4113-b421-2d31019812f8 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:27.006242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-aa578c82-e3e0-4113-b421-2d31019812f8 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:27.008466 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa578c82-e3e0-4113-b421-2d31019812f8 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:27.008953 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa578c82-e3e0-4113-b421-2d31019812f8 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:27.009392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa578c82-e3e0-4113-b421-2d31019812f8 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:27.010105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa578c82-e3e0-4113-b421-2d31019812f8 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:27.010561 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa578c82-e3e0-4113-b421-2d31019812f8 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:27.010988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aa578c82-e3e0-4113-b421-2d31019812f8 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:27.138887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-aa578c82-e3e0-4113-b421-2d31019812f8 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:27.146655 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-aa578c82-e3e0-4113-b421-2d31019812f8 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1681 microversion: 2.1 time: 0.148781 Sep 14 12:17:27.147224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 532/1059] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:26 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:28.170560 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-59e70838-61c1-4063-83c7-c5a8b0535724 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:28.171290 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-59e70838-61c1-4063-83c7-c5a8b0535724 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:28.177574 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e70838-61c1-4063-83c7-c5a8b0535724 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:28.178085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e70838-61c1-4063-83c7-c5a8b0535724 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:28.178519 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e70838-61c1-4063-83c7-c5a8b0535724 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:28.179199 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e70838-61c1-4063-83c7-c5a8b0535724 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:28.179647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e70838-61c1-4063-83c7-c5a8b0535724 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:28.180066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-59e70838-61c1-4063-83c7-c5a8b0535724 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:28.309334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1303b8e4-d7d4-41a2-b40f-27d5748daaa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:28.310072 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1303b8e4-d7d4-41a2-b40f-27d5748daaa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:28.316534 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1303b8e4-d7d4-41a2-b40f-27d5748daaa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:28.317025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1303b8e4-d7d4-41a2-b40f-27d5748daaa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:28.317465 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1303b8e4-d7d4-41a2-b40f-27d5748daaa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:28.318206 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1303b8e4-d7d4-41a2-b40f-27d5748daaa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:28.318665 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1303b8e4-d7d4-41a2-b40f-27d5748daaa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:28.319089 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1303b8e4-d7d4-41a2-b40f-27d5748daaa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:28.326484 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-59e70838-61c1-4063-83c7-c5a8b0535724 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:28.334636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-59e70838-61c1-4063-83c7-c5a8b0535724 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1681 microversion: 2.1 time: 0.168195 Sep 14 12:17:28.335331 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 528/1060] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:28 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:28.352585 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1303b8e4-d7d4-41a2-b40f-27d5748daaa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments/f4f7a3fc-2e39-4bcb-a1c9-9f126b1a9013" status: 200 len: 194 microversion: 2.1 time: 0.047807 Sep 14 12:17:28.353206 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 533/1061] 10.222.0.62 () {58 vars in 1413 bytes} [Wed Sep 14 12:17:28 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments/f4f7a3fc-2e39-4bcb-a1c9-9f126b1a9013 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:17:28.363957 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-04f94db5-db2a-40e2-84cf-962752463f88 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:28.364450 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-04f94db5-db2a-40e2-84cf-962752463f88 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:28.371050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f94db5-db2a-40e2-84cf-962752463f88 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:28.372000 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f94db5-db2a-40e2-84cf-962752463f88 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:28.372000 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f94db5-db2a-40e2-84cf-962752463f88 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:28.372672 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f94db5-db2a-40e2-84cf-962752463f88 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:28.373273 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f94db5-db2a-40e2-84cf-962752463f88 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:28.373551 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-04f94db5-db2a-40e2-84cf-962752463f88 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:28.458858 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-04f94db5-db2a-40e2-84cf-962752463f88 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lazy-loading 'services' on Instance uuid 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:17:28.648979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-04f94db5-db2a-40e2-84cf-962752463f88 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "DELETE /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments/f4f7a3fc-2e39-4bcb-a1c9-9f126b1a9013" status: 202 len: 0 microversion: 2.1 time: 0.288813 Sep 14 12:17:28.649572 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 529/1062] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:17:28 2022] DELETE /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments/f4f7a3fc-2e39-4bcb-a1c9-9f126b1a9013 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:17:29.358648 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9c99e1b7-3292-41ad-a370-0e8818166a8c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:29.359256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9c99e1b7-3292-41ad-a370-0e8818166a8c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:29.365681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9c99e1b7-3292-41ad-a370-0e8818166a8c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:29.366190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9c99e1b7-3292-41ad-a370-0e8818166a8c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:29.366623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9c99e1b7-3292-41ad-a370-0e8818166a8c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:29.367306 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9c99e1b7-3292-41ad-a370-0e8818166a8c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:29.367766 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9c99e1b7-3292-41ad-a370-0e8818166a8c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:29.368187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9c99e1b7-3292-41ad-a370-0e8818166a8c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:29.498344 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9c99e1b7-3292-41ad-a370-0e8818166a8c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:29.505926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9c99e1b7-3292-41ad-a370-0e8818166a8c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1681 microversion: 2.1 time: 0.151188 Sep 14 12:17:29.506496 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 534/1063] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:29 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:30.530515 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-00b405e7-64b7-488a-966e-b90c9a757f09 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:30.531233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-00b405e7-64b7-488a-966e-b90c9a757f09 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:30.544176 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00b405e7-64b7-488a-966e-b90c9a757f09 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:30.545197 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00b405e7-64b7-488a-966e-b90c9a757f09 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:30.546290 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00b405e7-64b7-488a-966e-b90c9a757f09 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:30.547370 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00b405e7-64b7-488a-966e-b90c9a757f09 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:30.548053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00b405e7-64b7-488a-966e-b90c9a757f09 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:30.548707 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-00b405e7-64b7-488a-966e-b90c9a757f09 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:30.630949 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-00b405e7-64b7-488a-966e-b90c9a757f09 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:30.640397 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-00b405e7-64b7-488a-966e-b90c9a757f09 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1613 microversion: 2.1 time: 0.114728 Sep 14 12:17:30.641448 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 530/1064] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:30 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1613 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:30.772392 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-db2d0dea-2f64-450e-a0a5-64325417143c req-b6724df9-f32f-4abb-8f68-22f219fc180a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bf2654-f27a-4ec4-9dba-d70e557034df", "name": "network-vif-deleted", "tag": "2f4cdaf2-f722-4368-bdce-05dda4448873"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:17:30.800000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-db2d0dea-2f64-450e-a0a5-64325417143c req-b6724df9-f32f-4abb-8f68-22f219fc180a service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:30.800365 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-db2d0dea-2f64-450e-a0a5-64325417143c req-b6724df9-f32f-4abb-8f68-22f219fc180a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:30.800796 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-db2d0dea-2f64-450e-a0a5-64325417143c req-b6724df9-f32f-4abb-8f68-22f219fc180a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:30.823842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-db2d0dea-2f64-450e-a0a5-64325417143c req-b6724df9-f32f-4abb-8f68-22f219fc180a service nova] Creating event network-vif-deleted:2f4cdaf2-f722-4368-bdce-05dda4448873 for instance a6bf2654-f27a-4ec4-9dba-d70e557034df on hv-cinder-84496 Sep 14 12:17:30.831047 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-db2d0dea-2f64-450e-a0a5-64325417143c req-b6724df9-f32f-4abb-8f68-22f219fc180a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299862 Sep 14 12:17:30.831951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 535/1065] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:17:30.920543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2f50db0f-ec31-473a-b753-9093bb3f667f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:30.922855 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2f50db0f-ec31-473a-b753-9093bb3f667f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:30.928966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f50db0f-ec31-473a-b753-9093bb3f667f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:30.929453 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f50db0f-ec31-473a-b753-9093bb3f667f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:30.929913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f50db0f-ec31-473a-b753-9093bb3f667f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:30.930683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f50db0f-ec31-473a-b753-9093bb3f667f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:30.931136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f50db0f-ec31-473a-b753-9093bb3f667f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:30.931562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f50db0f-ec31-473a-b753-9093bb3f667f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:30.962057 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2f50db0f-ec31-473a-b753-9093bb3f667f tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045931 Sep 14 12:17:30.962638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 531/1066] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:30 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 12:17:31.099470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5d2df239-48c5-40da-99a3-8c2339ac51b5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:31.101942 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5d2df239-48c5-40da-99a3-8c2339ac51b5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:31.108795 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5d2df239-48c5-40da-99a3-8c2339ac51b5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:31.109290 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5d2df239-48c5-40da-99a3-8c2339ac51b5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:31.109776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5d2df239-48c5-40da-99a3-8c2339ac51b5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:31.110502 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5d2df239-48c5-40da-99a3-8c2339ac51b5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:31.110956 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5d2df239-48c5-40da-99a3-8c2339ac51b5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:31.111381 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5d2df239-48c5-40da-99a3-8c2339ac51b5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:31.140878 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5d2df239-48c5-40da-99a3-8c2339ac51b5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045548 Sep 14 12:17:31.141348 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 536/1067] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:17:31 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 12:17:31.205079 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-299a24ef-964b-4772-baea-9f63c1cf3648 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:31.205580 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-299a24ef-964b-4772-baea-9f63c1cf3648 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:31.211813 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-299a24ef-964b-4772-baea-9f63c1cf3648 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:31.212306 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-299a24ef-964b-4772-baea-9f63c1cf3648 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:31.212755 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-299a24ef-964b-4772-baea-9f63c1cf3648 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:31.214099 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-299a24ef-964b-4772-baea-9f63c1cf3648 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:31.214557 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-299a24ef-964b-4772-baea-9f63c1cf3648 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:31.215041 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-299a24ef-964b-4772-baea-9f63c1cf3648 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:31.241006 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-299a24ef-964b-4772-baea-9f63c1cf3648 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:17:31.276180 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:31.535057 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-299a24ef-964b-4772-baea-9f63c1cf3648 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "DELETE /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 204 len: 0 microversion: 2.1 time: 0.333566 Sep 14 12:17:31.535885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 532/1068] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:17:31 2022] DELETE /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:17:31.544721 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0a4ab911-2744-4fd5-914f-3e320019c2aa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:31.545333 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0a4ab911-2744-4fd5-914f-3e320019c2aa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:31.551865 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0a4ab911-2744-4fd5-914f-3e320019c2aa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:31.552356 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0a4ab911-2744-4fd5-914f-3e320019c2aa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:31.552789 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0a4ab911-2744-4fd5-914f-3e320019c2aa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:31.553477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0a4ab911-2744-4fd5-914f-3e320019c2aa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:31.553955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0a4ab911-2744-4fd5-914f-3e320019c2aa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:31.554379 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0a4ab911-2744-4fd5-914f-3e320019c2aa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:31.665182 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:31.665994 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:31.672167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:31.672735 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:31.673246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:31.674063 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:31.674529 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:31.674953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:31.691673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0a4ab911-2744-4fd5-914f-3e320019c2aa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:31.702530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0a4ab911-2744-4fd5-914f-3e320019c2aa tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1673 microversion: 2.1 time: 0.161861 Sep 14 12:17:31.703060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 537/1069] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:31 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:31.708528 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:31.709012 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:31.709449 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:31.709922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lazy-loading 'fault' on Instance uuid a6bf2654-f27a-4ec4-9dba-d70e557034df {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:17:31.750276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:31.757808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-56524dd8-8368-4985-ae84-83b5e366b8c7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1331 microversion: 2.1 time: 0.096967 Sep 14 12:17:31.758402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 533/1070] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:31 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:17:32.730666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-154d338f-2bcb-43e3-adba-70a7b512ffa7 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:32.731285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-154d338f-2bcb-43e3-adba-70a7b512ffa7 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:32.737663 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-154d338f-2bcb-43e3-adba-70a7b512ffa7 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:32.738180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-154d338f-2bcb-43e3-adba-70a7b512ffa7 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:32.738621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-154d338f-2bcb-43e3-adba-70a7b512ffa7 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:32.739305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-154d338f-2bcb-43e3-adba-70a7b512ffa7 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:32.739757 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-154d338f-2bcb-43e3-adba-70a7b512ffa7 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:32.740194 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-154d338f-2bcb-43e3-adba-70a7b512ffa7 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:32.782274 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:32.782982 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:32.789146 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:32.789631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:32.790102 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:32.790798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:32.791255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:32.791679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:32.825672 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:32.825672 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:32.825672 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:32.825672 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lazy-loading 'fault' on Instance uuid a6bf2654-f27a-4ec4-9dba-d70e557034df {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:17:32.875003 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:32.882485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-df460f6a-3f20-4b7b-86e8-2104ff17e52d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 200 len: 1331 microversion: 2.1 time: 0.104012 Sep 14 12:17:32.883297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 534/1071] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:32 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:17:32.896797 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-154d338f-2bcb-43e3-adba-70a7b512ffa7 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:32.904940 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-154d338f-2bcb-43e3-adba-70a7b512ffa7 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1673 microversion: 2.1 time: 0.178123 Sep 14 12:17:32.905513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 538/1072] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:32 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:33.907365 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:33.908096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:33.914974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:33.915388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:33.915828 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:33.916524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:33.916987 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:33.917419 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:33.928103 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a7749f36-15d0-436b-a07f-c3a2633b67e8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:33.928732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a7749f36-15d0-436b-a07f-c3a2633b67e8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:33.930926 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df HTTP/1.1 Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:17:33.932625 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:17:33.934091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': 'a6bf2654-f27a-4ec4-9dba-d70e557034df'} Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:17:33.934917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:17:33.936285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:33.937472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:17:33.937472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-85605e23-dc1f-4b81-9985-dd35b938fa6e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 404 len: 111 microversion: 2.1 time: 0.030658 Sep 14 12:17:33.937472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 535/1073] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:33 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:17:33.937694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a7749f36-15d0-436b-a07f-c3a2633b67e8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:33.937694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a7749f36-15d0-436b-a07f-c3a2633b67e8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:33.937694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a7749f36-15d0-436b-a07f-c3a2633b67e8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:33.937694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a7749f36-15d0-436b-a07f-c3a2633b67e8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:33.938050 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a7749f36-15d0-436b-a07f-c3a2633b67e8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:33.938050 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a7749f36-15d0-436b-a07f-c3a2633b67e8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:33.942421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-56d0c283-a1fa-4479-8a70-621ed7886fee tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '.version_select at 0x7f1c99f3fdc0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:33.946975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56d0c283-a1fa-4479-8a70-621ed7886fee tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [df0b1307-9c31-41c7-bd39-d373bc4a1809] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 12:17:34.067954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a7749f36-15d0-436b-a07f-c3a2633b67e8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:34.076450 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a7749f36-15d0-436b-a07f-c3a2633b67e8 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1673 microversion: 2.1 time: 0.152217 Sep 14 12:17:34.076963 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 539/1074] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:33 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:17:34.954656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [None req-56d0c283-a1fa-4479-8a70-621ed7886fee tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [df0b1307-9c31-41c7-bd39-d373bc4a1809] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 56258. Sep 14 12:17:35.011134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-56d0c283-a1fa-4479-8a70-621ed7886fee tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417724504" status: 202 len: 0 microversion: 2.1 time: 1.072132 Sep 14 12:17:35.012226 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 536/1075] 10.222.0.62 () {58 vars in 1221 bytes} [Wed Sep 14 12:17:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417724504 => generated 0 bytes in 1074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 12:17:35.032129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-6b032994-bde3-454e-93b7-399c4bee9d86 req-e26fba07-3814-4e0f-a3f8-dbb84be01272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637a4311-34dd-4f5e-b0c9-e32ec1a8a12b", "name": "network-vif-deleted", "tag": "10f04e67-d152-402d-b0fd-e0db630ba32c"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:17:35.043214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6b032994-bde3-454e-93b7-399c4bee9d86 req-e26fba07-3814-4e0f-a3f8-dbb84be01272 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:35.044837 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6b032994-bde3-454e-93b7-399c4bee9d86 req-e26fba07-3814-4e0f-a3f8-dbb84be01272 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:35.045471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6b032994-bde3-454e-93b7-399c4bee9d86 req-e26fba07-3814-4e0f-a3f8-dbb84be01272 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:35.058161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-6b032994-bde3-454e-93b7-399c4bee9d86 req-e26fba07-3814-4e0f-a3f8-dbb84be01272 service nova] Creating event network-vif-deleted:10f04e67-d152-402d-b0fd-e0db630ba32c for instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b on hv-cinder-84496 Sep 14 12:17:35.064887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-6b032994-bde3-454e-93b7-399c4bee9d86 req-e26fba07-3814-4e0f-a3f8-dbb84be01272 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035537 Sep 14 12:17:35.066023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 540/1076] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:35.104846 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-33e9024b-20ae-4696-a7dc-0dcc18600865 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:35.106329 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-33e9024b-20ae-4696-a7dc-0dcc18600865 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:35.113740 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33e9024b-20ae-4696-a7dc-0dcc18600865 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:35.114969 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33e9024b-20ae-4696-a7dc-0dcc18600865 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:35.115632 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33e9024b-20ae-4696-a7dc-0dcc18600865 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:35.116551 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33e9024b-20ae-4696-a7dc-0dcc18600865 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:35.117174 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33e9024b-20ae-4696-a7dc-0dcc18600865 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:35.117830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-33e9024b-20ae-4696-a7dc-0dcc18600865 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:35.199149 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-33e9024b-20ae-4696-a7dc-0dcc18600865 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba1860ce5504c27816a504776463d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35c2ab9a9644cadadd4da9a544b944b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:35.208237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-33e9024b-20ae-4696-a7dc-0dcc18600865 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 200 len: 1606 microversion: 2.1 time: 0.109917 Sep 14 12:17:35.208873 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 537/1077] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:35 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 1606 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:35.818234 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9d2d354f-0e7c-469c-b202-d1cdf2b54580 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: .version_select at 0x7f1c99d033a0>, body: {"keypair": {"name": "tempest-keypair-1035052059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQ6fWYDBj0gW0dbSGgNVrEi/URLQpBI9ox9gjEx1tbIJuXLo5LcC6YGQ3aONVPLc3YBlW3z9eR++uTuJL22A0XCU1ZJpVb6AnaDaJHW6ezCYewruic2LMzHAW0V7XxYQA=="}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:17:35.835214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-9d2d354f-0e7c-469c-b202-d1cdf2b54580 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for project 5b86ec91335c49aaa672aa85461d2936. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:17:35.839770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-9d2d354f-0e7c-469c-b202-d1cdf2b54580 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for user 31f3271adc36406fb303fb169020e740 and project 5b86ec91335c49aaa672aa85461d2936. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:17:35.852082 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d2d354f-0e7c-469c-b202-d1cdf2b54580 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [79d59526-bb1f-4b39-ab8c-c4c8cdf62bf1] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 12:17:36.231793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:36.232539 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:36.239078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:36.245155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:36.245155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:36.245155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:36.245155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:36.245654 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:36.256318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] HTTP exception thrown: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Request method failure captured: Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b HTTP/1.1 Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcO0Irlx0GI5viiJ5gPPLZGZ3QR43QeUDcz6ynKAS749BzWiJT_HrB0lZgF_uTZ_WaQi1-pF7ByTzGqYR0biRVT5Qw7OrUyzndtcagnFaplH1_P412mOI-mKbAF5eRuisbB46BFEhJNwC1z2NuntWmXkT01GbqjYq8vQPQO3S4dc3BU Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:17:36.257897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}] Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 2ba1860ce5504c27816a504776463d9c Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:36.259373 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '637a4311-34dd-4f5e-b0c9-e32ec1a8a12b'} Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:17:36.261962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:36.263662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:17:36.265075 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Returning 404 to user: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:17:36.265075 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-26d4de8d-4d49-48bc-b50d-0c274bb53175 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 404 len: 111 microversion: 2.1 time: 0.031609 Sep 14 12:17:36.265075 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 538/1078] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:36 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:17:36.269763 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-385bb276-3863-4ab2-9264-602159c71b7b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '.version_select at 0x7f1c99d2ce50>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:36.359110 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-385bb276-3863-4ab2-9264-602159c71b7b tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428259511" status: 202 len: 0 microversion: 2.1 time: 0.093035 Sep 14 12:17:36.359703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 539/1079] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Sep 14 12:17:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428259511 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:17:36.860114 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d2d354f-0e7c-469c-b202-d1cdf2b54580 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [79d59526-bb1f-4b39-ab8c-c4c8cdf62bf1] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 56282. Sep 14 12:17:36.948053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9d2d354f-0e7c-469c-b202-d1cdf2b54580 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.134135 Sep 14 12:17:36.948661 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 541/1080] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 14 12:17:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:39.315795 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1172863874", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf307d40-f42c-4be6-8979-65e762517b0f"}], "security_groups": [{"name": "tempest-securitygroup--1553613971"}], "key_name": "tempest-keypair-1035052059", "user_data": "}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:17:39.418348 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] validate_networks() for [('cf307d40-f42c-4be6-8979-65e762517b0f', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:17:39.647389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:39.648387 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:39.657517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:39.658137 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:39.658582 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:39.659299 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:39.659767 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:39.660190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:39.663046 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:39.674894 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] HTTP exception thrown: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Request method failure captured: Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b HTTP/1.1 Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcO0Irlx0GI5viiJ5gPPLZGZ3QR43QeUDcz6ynKAS749BzWiJT_HrB0lZgF_uTZ_WaQi1-pF7ByTzGqYR0biRVT5Qw7OrUyzndtcagnFaplH1_P412mOI-mKbAF5eRuisbB46BFEhJNwC1z2NuntWmXkT01GbqjYq8vQPQO3S4dc3BU Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:17:39.677351 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}] Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 2ba1860ce5504c27816a504776463d9c Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:39.678973 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '637a4311-34dd-4f5e-b0c9-e32ec1a8a12b'} Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:17:39.679715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:39.681036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:39.682330 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Returning 404 to user: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:17:39.682330 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3a1446da-105b-4122-bce3-37d7b4c7dfa5 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "DELETE /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 404 len: 111 microversion: 2.1 time: 0.035144 Sep 14 12:17:39.682330 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 542/1081] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:17:39 2022] DELETE /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:17:39.687755 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:39.688387 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:39.695275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:39.695756 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:39.696201 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:39.696920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:39.697384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:39.697813 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:39.714218 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] HTTP exception thrown: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Request method failure captured: Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b HTTP/1.1 Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcO0Irlx0GI5viiJ5gPPLZGZ3QR43QeUDcz6ynKAS749BzWiJT_HrB0lZgF_uTZ_WaQi1-pF7ByTzGqYR0biRVT5Qw7OrUyzndtcagnFaplH1_P412mOI-mKbAF5eRuisbB46BFEhJNwC1z2NuntWmXkT01GbqjYq8vQPQO3S4dc3BU Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:17:39.720081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}] Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 2ba1860ce5504c27816a504776463d9c Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:39.721548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '637a4311-34dd-4f5e-b0c9-e32ec1a8a12b'} Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:17:39.722436 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. Sep 14 12:17:39.724223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:39.725328 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Returning 404 to user: Instance 637a4311-34dd-4f5e-b0c9-e32ec1a8a12b could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:17:39.725328 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6b82ecc5-0084-49fc-84a3-7e2eee551e62 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b" status: 404 len: 111 microversion: 2.1 time: 0.033714 Sep 14 12:17:39.725328 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 543/1082] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:39 2022] GET /compute/v2.1/servers/637a4311-34dd-4f5e-b0c9-e32ec1a8a12b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:17:40.043142 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:17:40.043589 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:17:40.044092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:17:40.044504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:17:40.044914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:17:40.053448 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:40.053961 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:40.054397 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:40.055120 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:40.055571 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:40.055993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:40.073119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for project 5b86ec91335c49aaa672aa85461d2936. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:17:40.077070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Getting quotas for user 31f3271adc36406fb303fb169020e740 and project 5b86ec91335c49aaa672aa85461d2936. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:17:40.087797 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:17:40.090836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:17:40.192165 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [729f202c-c915-43ed-992a-dbcbb4456301] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 12:17:40.997217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:40.997753 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:41.004553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:41.005026 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:41.005584 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:41.006313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:41.006771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:41.007198 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:41.021224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] HTTP exception thrown: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Request method failure captured: Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b HTTP/1.1 Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcO0Irlx0GI5viiJ5gPPLZGZ3QR43QeUDcz6ynKAS749BzWiJT_HrB0lZgF_uTZ_WaQi1-pF7ByTzGqYR0biRVT5Qw7OrUyzndtcagnFaplH1_P412mOI-mKbAF5eRuisbB46BFEhJNwC1z2NuntWmXkT01GbqjYq8vQPQO3S4dc3BU Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:17:41.023084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}] Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 2ba1860ce5504c27816a504776463d9c Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:17:41.024715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '76ce41d2-7079-429c-a18a-de51b2c20e6b'} Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:17:41.025583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:17:41.027135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:41.028976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Returning 404 to user: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:17:41.028976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-44edc5de-6bac-4b98-ba70-a3f91cc0c464 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "DELETE /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 404 len: 111 microversion: 2.1 time: 0.032047 Sep 14 12:17:41.028976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 544/1083] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:17:40 2022] DELETE /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:17:41.032537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:41.033137 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] [instance: 76ce41d2-7079-429c-a18a-de51b2c20e6b] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:41.039217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:41.039692 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:41.040122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:41.040806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:41.041253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:41.041670 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:41.054690 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] HTTP exception thrown: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Request method failure captured: Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b HTTP/1.1 Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcO0Irlx0GI5viiJ5gPPLZGZ3QR43QeUDcz6ynKAS749BzWiJT_HrB0lZgF_uTZ_WaQi1-pF7ByTzGqYR0biRVT5Qw7OrUyzndtcagnFaplH1_P412mOI-mKbAF5eRuisbB46BFEhJNwC1z2NuntWmXkT01GbqjYq8vQPQO3S4dc3BU Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:17:41.056200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e35c2ab9a9644cadadd4da9a544b944b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35c2ab9a9644cadadd4da9a544b944b"}]}] Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: e35c2ab9a9644cadadd4da9a544b944b Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeTestJSON-259790065 Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 2ba1860ce5504c27816a504776463d9c Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeTestJSON-259790065-project Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:17:41.058362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '76ce41d2-7079-429c-a18a-de51b2c20e6b'} Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:17:41.059280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. Sep 14 12:17:41.060726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:17:41.062226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] Returning 404 to user: Instance 76ce41d2-7079-429c-a18a-de51b2c20e6b could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:17:41.062226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b88bf1b7-78df-42e6-af7d-fd260413d318 tempest-AttachVolumeTestJSON-259790065 tempest-AttachVolumeTestJSON-259790065-project] 10.222.0.62 "GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b" status: 404 len: 111 microversion: 2.1 time: 0.028630 Sep 14 12:17:41.062226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 545/1084] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:41 2022] GET /compute/v2.1/servers/76ce41d2-7079-429c-a18a-de51b2c20e6b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:17:41.199892 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [729f202c-c915-43ed-992a-dbcbb4456301] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 56336. Sep 14 12:17:41.204340 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fd3593b7-812d-436d-a011-ce3bde451a39 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.893503 Sep 14 12:17:41.205010 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 540/1085] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:17:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:17:41.216336 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8a9c7767-023a-4dfb-bd9a-05e114594b77 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:41.216957 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8a9c7767-023a-4dfb-bd9a-05e114594b77 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:41.287144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8a9c7767-023a-4dfb-bd9a-05e114594b77 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:41.294438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8a9c7767-023a-4dfb-bd9a-05e114594b77 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1242 microversion: 2.1 time: 0.082168 Sep 14 12:17:41.295014 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 546/1086] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:41 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:42.317228 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0f0a110f-a477-4331-b24f-39563b7ccc48 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:42.318414 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0f0a110f-a477-4331-b24f-39563b7ccc48 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:42.414837 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0f0a110f-a477-4331-b24f-39563b7ccc48 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:42.422693 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0f0a110f-a477-4331-b24f-39563b7ccc48 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1242 microversion: 2.1 time: 0.109670 Sep 14 12:17:42.423294 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 541/1087] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:42 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:43.445835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ee8f07b6-e29e-495f-b0c5-7f6a070b288c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:43.446568 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ee8f07b6-e29e-495f-b0c5-7f6a070b288c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:43.514755 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ee8f07b6-e29e-495f-b0c5-7f6a070b288c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:43.524300 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ee8f07b6-e29e-495f-b0c5-7f6a070b288c tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1242 microversion: 2.1 time: 0.082346 Sep 14 12:17:43.525101 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 547/1088] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:43 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:44.548244 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-99570b64-8606-4167-92b3-b23fe70c5c50 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:44.549072 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-99570b64-8606-4167-92b3-b23fe70c5c50 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:44.650063 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-99570b64-8606-4167-92b3-b23fe70c5c50 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:44.654961 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-99570b64-8606-4167-92b3-b23fe70c5c50 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1242 microversion: 2.1 time: 0.110665 Sep 14 12:17:44.655534 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 542/1089] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:44 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:45.677216 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0057621c-076d-48a4-9b0c-dd96ea1ebc26 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:45.677782 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0057621c-076d-48a4-9b0c-dd96ea1ebc26 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:45.684257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0057621c-076d-48a4-9b0c-dd96ea1ebc26 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:45.686559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0057621c-076d-48a4-9b0c-dd96ea1ebc26 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:45.686559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0057621c-076d-48a4-9b0c-dd96ea1ebc26 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:45.686559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0057621c-076d-48a4-9b0c-dd96ea1ebc26 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:45.686559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0057621c-076d-48a4-9b0c-dd96ea1ebc26 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:45.686919 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0057621c-076d-48a4-9b0c-dd96ea1ebc26 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:45.748173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0057621c-076d-48a4-9b0c-dd96ea1ebc26 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:45.755841 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0057621c-076d-48a4-9b0c-dd96ea1ebc26 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1246 microversion: 2.1 time: 0.082599 Sep 14 12:17:45.756407 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 548/1090] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:45 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:46.780572 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c59af0ac-3de5-4426-89db-11444cc8f88e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:46.781364 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c59af0ac-3de5-4426-89db-11444cc8f88e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:46.788009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c59af0ac-3de5-4426-89db-11444cc8f88e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:46.788502 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c59af0ac-3de5-4426-89db-11444cc8f88e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:46.788941 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c59af0ac-3de5-4426-89db-11444cc8f88e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:46.789724 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c59af0ac-3de5-4426-89db-11444cc8f88e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:46.790210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c59af0ac-3de5-4426-89db-11444cc8f88e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:46.797111 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c59af0ac-3de5-4426-89db-11444cc8f88e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:46.851738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c59af0ac-3de5-4426-89db-11444cc8f88e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:46.859481 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c59af0ac-3de5-4426-89db-11444cc8f88e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1294 microversion: 2.1 time: 0.083632 Sep 14 12:17:46.860047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 543/1091] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:46 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:47.883345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-be2c693a-2da3-4bef-bd26-64af2ba7e933 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:47.884055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-be2c693a-2da3-4bef-bd26-64af2ba7e933 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:47.890607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-be2c693a-2da3-4bef-bd26-64af2ba7e933 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:47.891094 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-be2c693a-2da3-4bef-bd26-64af2ba7e933 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:47.891524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-be2c693a-2da3-4bef-bd26-64af2ba7e933 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:47.892209 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-be2c693a-2da3-4bef-bd26-64af2ba7e933 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:47.892663 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-be2c693a-2da3-4bef-bd26-64af2ba7e933 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:47.893068 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-be2c693a-2da3-4bef-bd26-64af2ba7e933 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:47.976521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-be2c693a-2da3-4bef-bd26-64af2ba7e933 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:47.985419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-be2c693a-2da3-4bef-bd26-64af2ba7e933 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1300 microversion: 2.1 time: 0.106011 Sep 14 12:17:47.987886 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 549/1092] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:47 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:49.009059 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a6d6ee03-4527-4c88-a57f-96f4ea29e303 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:49.009669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a6d6ee03-4527-4c88-a57f-96f4ea29e303 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:49.012933 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:49.017602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d6ee03-4527-4c88-a57f-96f4ea29e303 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:49.018164 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d6ee03-4527-4c88-a57f-96f4ea29e303 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:49.018604 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d6ee03-4527-4c88-a57f-96f4ea29e303 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:49.019308 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d6ee03-4527-4c88-a57f-96f4ea29e303 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:49.019764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d6ee03-4527-4c88-a57f-96f4ea29e303 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:49.020195 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a6d6ee03-4527-4c88-a57f-96f4ea29e303 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:49.269589 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a6d6ee03-4527-4c88-a57f-96f4ea29e303 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:49.279265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a6d6ee03-4527-4c88-a57f-96f4ea29e303 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1368 microversion: 2.1 time: 0.274138 Sep 14 12:17:49.280056 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 544/1093] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:49 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:49.370849 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-292e83a7-a165-4c69-811b-f9d34340829d req-f41d7e13-95a6-4997-8ce3-05161fd36a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1fea63d-cc7a-42e9-bde3-86947d2e0999", "tag": "cffd5a86-a259-44e3-9a06-15412c4a2457"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:17:49.380418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-292e83a7-a165-4c69-811b-f9d34340829d req-f41d7e13-95a6-4997-8ce3-05161fd36a4d service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:49.380892 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-292e83a7-a165-4c69-811b-f9d34340829d req-f41d7e13-95a6-4997-8ce3-05161fd36a4d service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:49.381313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-292e83a7-a165-4c69-811b-f9d34340829d req-f41d7e13-95a6-4997-8ce3-05161fd36a4d service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:49.392509 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-292e83a7-a165-4c69-811b-f9d34340829d req-f41d7e13-95a6-4997-8ce3-05161fd36a4d service nova] Creating event network-changed:cffd5a86-a259-44e3-9a06-15412c4a2457 for instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 on hv-cinder-84496 Sep 14 12:17:49.397660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-292e83a7-a165-4c69-811b-f9d34340829d req-f41d7e13-95a6-4997-8ce3-05161fd36a4d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030307 Sep 14 12:17:49.398302 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 550/1094] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:50.303090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bba8b6c7-f629-491f-af3a-6bc3cdd036ba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:50.303722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bba8b6c7-f629-491f-af3a-6bc3cdd036ba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:50.306313 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:50.312011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bba8b6c7-f629-491f-af3a-6bc3cdd036ba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:50.312511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bba8b6c7-f629-491f-af3a-6bc3cdd036ba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:50.313140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bba8b6c7-f629-491f-af3a-6bc3cdd036ba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:50.314609 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bba8b6c7-f629-491f-af3a-6bc3cdd036ba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:50.315069 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bba8b6c7-f629-491f-af3a-6bc3cdd036ba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:50.315682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bba8b6c7-f629-491f-af3a-6bc3cdd036ba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:50.452428 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bba8b6c7-f629-491f-af3a-6bc3cdd036ba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:50.460341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bba8b6c7-f629-491f-af3a-6bc3cdd036ba tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1368 microversion: 2.1 time: 0.161140 Sep 14 12:17:50.460919 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 545/1095] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:50 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:51.489382 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-846ec6d6-85eb-4ce0-b98e-5a9733b54311 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:51.490113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-846ec6d6-85eb-4ce0-b98e-5a9733b54311 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:51.492154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:51.497550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-846ec6d6-85eb-4ce0-b98e-5a9733b54311 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:51.498060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-846ec6d6-85eb-4ce0-b98e-5a9733b54311 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:51.503607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-846ec6d6-85eb-4ce0-b98e-5a9733b54311 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:51.503607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-846ec6d6-85eb-4ce0-b98e-5a9733b54311 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:51.503607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-846ec6d6-85eb-4ce0-b98e-5a9733b54311 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:51.503607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-846ec6d6-85eb-4ce0-b98e-5a9733b54311 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:51.632710 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-846ec6d6-85eb-4ce0-b98e-5a9733b54311 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:51.641022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-846ec6d6-85eb-4ce0-b98e-5a9733b54311 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1368 microversion: 2.1 time: 0.156499 Sep 14 12:17:51.641591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 551/1096] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:51 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:52.664160 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d6bc1128-83c3-410e-a5a9-05e23e815347 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:52.664667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d6bc1128-83c3-410e-a5a9-05e23e815347 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:52.670849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6bc1128-83c3-410e-a5a9-05e23e815347 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:52.671342 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6bc1128-83c3-410e-a5a9-05e23e815347 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:52.671786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6bc1128-83c3-410e-a5a9-05e23e815347 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:52.672489 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6bc1128-83c3-410e-a5a9-05e23e815347 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:52.672945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6bc1128-83c3-410e-a5a9-05e23e815347 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:52.673376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6bc1128-83c3-410e-a5a9-05e23e815347 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:52.811298 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d6bc1128-83c3-410e-a5a9-05e23e815347 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:52.819208 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d6bc1128-83c3-410e-a5a9-05e23e815347 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1368 microversion: 2.1 time: 0.159220 Sep 14 12:17:52.820256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 546/1097] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:52 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:53.844113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c1d9bade-bec9-40e8-a002-1a7641c6dce4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:53.844720 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c1d9bade-bec9-40e8-a002-1a7641c6dce4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:53.848082 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=8 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:53.852841 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d9bade-bec9-40e8-a002-1a7641c6dce4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:53.852841 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d9bade-bec9-40e8-a002-1a7641c6dce4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:53.852841 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d9bade-bec9-40e8-a002-1a7641c6dce4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:53.853634 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d9bade-bec9-40e8-a002-1a7641c6dce4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:53.854108 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d9bade-bec9-40e8-a002-1a7641c6dce4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:53.855203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c1d9bade-bec9-40e8-a002-1a7641c6dce4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:53.983964 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c1d9bade-bec9-40e8-a002-1a7641c6dce4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:53.991984 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c1d9bade-bec9-40e8-a002-1a7641c6dce4 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1368 microversion: 2.1 time: 0.152316 Sep 14 12:17:53.992560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 552/1098] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:53 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:55.014922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-89851d9f-4cef-46b3-ad72-ce3d72b2e64e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:55.015544 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-89851d9f-4cef-46b3-ad72-ce3d72b2e64e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:55.018059 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=10 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:55.023553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-89851d9f-4cef-46b3-ad72-ce3d72b2e64e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:55.024224 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-89851d9f-4cef-46b3-ad72-ce3d72b2e64e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:55.024830 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-89851d9f-4cef-46b3-ad72-ce3d72b2e64e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:55.025541 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-89851d9f-4cef-46b3-ad72-ce3d72b2e64e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:55.026025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-89851d9f-4cef-46b3-ad72-ce3d72b2e64e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:55.026453 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-89851d9f-4cef-46b3-ad72-ce3d72b2e64e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:55.165377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-89851d9f-4cef-46b3-ad72-ce3d72b2e64e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:55.174317 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-89851d9f-4cef-46b3-ad72-ce3d72b2e64e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1368 microversion: 2.1 time: 0.163298 Sep 14 12:17:55.174902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 547/1099] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:55 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:56.197169 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c851fbc5-01d8-4e94-80d9-5d113f7ac6d3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:56.197841 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c851fbc5-01d8-4e94-80d9-5d113f7ac6d3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:56.205231 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c851fbc5-01d8-4e94-80d9-5d113f7ac6d3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:56.209369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c851fbc5-01d8-4e94-80d9-5d113f7ac6d3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:56.209369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c851fbc5-01d8-4e94-80d9-5d113f7ac6d3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:56.209369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c851fbc5-01d8-4e94-80d9-5d113f7ac6d3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:56.209369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c851fbc5-01d8-4e94-80d9-5d113f7ac6d3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:56.209965 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c851fbc5-01d8-4e94-80d9-5d113f7ac6d3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:56.344804 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c851fbc5-01d8-4e94-80d9-5d113f7ac6d3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:56.353034 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c851fbc5-01d8-4e94-80d9-5d113f7ac6d3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1368 microversion: 2.1 time: 0.160051 Sep 14 12:17:56.353599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 553/1100] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:56 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:56.854758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-fea73958-fd6b-43aa-8dc9-0bbb186332b5 req-7169178d-dba3-4007-85b4-9782738c4668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fea63d-cc7a-42e9-bde3-86947d2e0999", "name": "network-vif-plugged", "status": "completed", "tag": "cffd5a86-a259-44e3-9a06-15412c4a2457"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:17:56.865670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-fea73958-fd6b-43aa-8dc9-0bbb186332b5 req-7169178d-dba3-4007-85b4-9782738c4668 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:56.866187 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-fea73958-fd6b-43aa-8dc9-0bbb186332b5 req-7169178d-dba3-4007-85b4-9782738c4668 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:56.866653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-fea73958-fd6b-43aa-8dc9-0bbb186332b5 req-7169178d-dba3-4007-85b4-9782738c4668 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:56.877934 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-fea73958-fd6b-43aa-8dc9-0bbb186332b5 req-7169178d-dba3-4007-85b4-9782738c4668 service nova] Creating event network-vif-plugged:cffd5a86-a259-44e3-9a06-15412c4a2457 for instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 on hv-cinder-84496 Sep 14 12:17:56.883064 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-fea73958-fd6b-43aa-8dc9-0bbb186332b5 req-7169178d-dba3-4007-85b4-9782738c4668 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032176 Sep 14 12:17:56.883647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 548/1101] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:17:57.376708 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-55ff3645-ba54-4998-a613-31c4e3ce1b5a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:57.377573 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-55ff3645-ba54-4998-a613-31c4e3ce1b5a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:57.384117 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55ff3645-ba54-4998-a613-31c4e3ce1b5a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:57.384673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55ff3645-ba54-4998-a613-31c4e3ce1b5a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:57.385168 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55ff3645-ba54-4998-a613-31c4e3ce1b5a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:57.385951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55ff3645-ba54-4998-a613-31c4e3ce1b5a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:57.386485 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55ff3645-ba54-4998-a613-31c4e3ce1b5a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:57.386907 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-55ff3645-ba54-4998-a613-31c4e3ce1b5a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:57.518949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-55ff3645-ba54-4998-a613-31c4e3ce1b5a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:57.527397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-55ff3645-ba54-4998-a613-31c4e3ce1b5a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1368 microversion: 2.1 time: 0.154669 Sep 14 12:17:57.538339 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 554/1102] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:57 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:58.551775 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-832e5484-5b12-4718-88bd-44595bbf3994 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:58.552401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-832e5484-5b12-4718-88bd-44595bbf3994 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:58.558694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-832e5484-5b12-4718-88bd-44595bbf3994 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:58.559184 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-832e5484-5b12-4718-88bd-44595bbf3994 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:58.559626 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-832e5484-5b12-4718-88bd-44595bbf3994 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:58.560322 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-832e5484-5b12-4718-88bd-44595bbf3994 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:58.560777 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-832e5484-5b12-4718-88bd-44595bbf3994 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:58.561209 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-832e5484-5b12-4718-88bd-44595bbf3994 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:58.693826 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-832e5484-5b12-4718-88bd-44595bbf3994 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:58.702124 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-832e5484-5b12-4718-88bd-44595bbf3994 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1368 microversion: 2.1 time: 0.154987 Sep 14 12:17:58.702691 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 549/1103] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:58 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:59.724923 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6bc1e77e-ab01-45a0-8c99-c970daab9c3f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:59.725474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6bc1e77e-ab01-45a0-8c99-c970daab9c3f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:59.732014 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bc1e77e-ab01-45a0-8c99-c970daab9c3f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:59.732522 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bc1e77e-ab01-45a0-8c99-c970daab9c3f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:59.733665 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bc1e77e-ab01-45a0-8c99-c970daab9c3f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:59.734400 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bc1e77e-ab01-45a0-8c99-c970daab9c3f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:59.735047 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bc1e77e-ab01-45a0-8c99-c970daab9c3f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:59.737631 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6bc1e77e-ab01-45a0-8c99-c970daab9c3f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:59.870172 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6bc1e77e-ab01-45a0-8c99-c970daab9c3f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:17:59.878604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6bc1e77e-ab01-45a0-8c99-c970daab9c3f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1558 microversion: 2.1 time: 0.157753 Sep 14 12:17:59.881115 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 555/1104] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:17:59 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:17:59.901936 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4fe3f9e4-28ba-4d6b-944f-e8420b83f574 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:17:59.904055 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4fe3f9e4-28ba-4d6b-944f-e8420b83f574 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:17:59.908788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fe3f9e4-28ba-4d6b-944f-e8420b83f574 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:59.909262 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fe3f9e4-28ba-4d6b-944f-e8420b83f574 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:59.909737 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fe3f9e4-28ba-4d6b-944f-e8420b83f574 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:59.910505 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fe3f9e4-28ba-4d6b-944f-e8420b83f574 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:17:59.910919 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fe3f9e4-28ba-4d6b-944f-e8420b83f574 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:17:59.911338 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4fe3f9e4-28ba-4d6b-944f-e8420b83f574 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:17:59.989526 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4fe3f9e4-28ba-4d6b-944f-e8420b83f574 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091869 Sep 14 12:17:59.990224 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 550/1105] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Sep 14 12:17:59 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:01.177732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-b5115e81-42ce-4dd6-83cb-c6f3b9fe0a64 req-efb9d365-b5c7-4832-9b38-69a8d8ab08e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1fea63d-cc7a-42e9-bde3-86947d2e0999", "tag": "cffd5a86-a259-44e3-9a06-15412c4a2457"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:18:01.187499 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b5115e81-42ce-4dd6-83cb-c6f3b9fe0a64 req-efb9d365-b5c7-4832-9b38-69a8d8ab08e9 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:01.187975 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b5115e81-42ce-4dd6-83cb-c6f3b9fe0a64 req-efb9d365-b5c7-4832-9b38-69a8d8ab08e9 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:01.188416 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b5115e81-42ce-4dd6-83cb-c6f3b9fe0a64 req-efb9d365-b5c7-4832-9b38-69a8d8ab08e9 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:01.199342 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-b5115e81-42ce-4dd6-83cb-c6f3b9fe0a64 req-efb9d365-b5c7-4832-9b38-69a8d8ab08e9 service nova] Creating event network-changed:cffd5a86-a259-44e3-9a06-15412c4a2457 for instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 on hv-cinder-84496 Sep 14 12:18:01.204356 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-b5115e81-42ce-4dd6-83cb-c6f3b9fe0a64 req-efb9d365-b5c7-4832-9b38-69a8d8ab08e9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030272 Sep 14 12:18:01.205014 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 556/1106] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:13.790076 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cefe9628-a968-42db-a7ae-ea6b4ead9ec9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:13.793509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cefe9628-a968-42db-a7ae-ea6b4ead9ec9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:13.797480 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=13 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:13.798280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:13.804242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cefe9628-a968-42db-a7ae-ea6b4ead9ec9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:13.808140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cefe9628-a968-42db-a7ae-ea6b4ead9ec9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:13.808140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cefe9628-a968-42db-a7ae-ea6b4ead9ec9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:13.808140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cefe9628-a968-42db-a7ae-ea6b4ead9ec9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:13.808140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cefe9628-a968-42db-a7ae-ea6b4ead9ec9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:13.808539 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cefe9628-a968-42db-a7ae-ea6b4ead9ec9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:13.837112 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cefe9628-a968-42db-a7ae-ea6b4ead9ec9 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051290 Sep 14 12:18:13.837681 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 551/1107] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Sep 14 12:18:13 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:18:13.900680 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=11 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:13.901389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=53 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:13.906053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3383a8a6-980d-49a2-a26b-f6283f64f256 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:13.906637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3383a8a6-980d-49a2-a26b-f6283f64f256 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:13.912773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3383a8a6-980d-49a2-a26b-f6283f64f256 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:13.913256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3383a8a6-980d-49a2-a26b-f6283f64f256 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:13.913697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3383a8a6-980d-49a2-a26b-f6283f64f256 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:13.914419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3383a8a6-980d-49a2-a26b-f6283f64f256 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:13.914986 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3383a8a6-980d-49a2-a26b-f6283f64f256 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:13.915441 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3383a8a6-980d-49a2-a26b-f6283f64f256 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:13.941238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3383a8a6-980d-49a2-a26b-f6283f64f256 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Going to try to terminate instance {{(pid=121152) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:18:14.220154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3383a8a6-980d-49a2-a26b-f6283f64f256 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 204 len: 0 microversion: 2.20 time: 0.321245 Sep 14 12:18:14.229503 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 557/1108] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Sep 14 12:18:13 2022] DELETE /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 12:18:14.229765 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:14.230591 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:14.236796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:14.237279 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:14.237713 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:14.238436 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:14.238880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:14.239302 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:14.408677 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:14.416675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:14.418215 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:14.419388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7f4a4566-a009-4b85-89bf-14ec856eb788 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.194249 Sep 14 12:18:14.419998 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 552/1109] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:18:14 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:18:15.446109 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:15.446890 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:15.453473 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:15.454001 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:15.454438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:15.455143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:15.455599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:15.456021 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:15.596673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:15.607624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:15.609085 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:15.610430 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-caeafd8d-695a-4cd3-8ea2-15d0e9ceaf94 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.168531 Sep 14 12:18:15.611006 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 558/1110] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:18:15 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:18:16.637454 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:16.639027 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:16.646350 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:16.647683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:16.648237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:16.649179 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:16.649702 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:16.650230 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:16.896332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:16.905368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:16.906844 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:16.908057 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3a98f67d-14fa-4a7f-bb4b-8238e451f776 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1721 microversion: 2.20 time: 0.275991 Sep 14 12:18:16.908639 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 553/1111] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:18:16 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:18:17.331940 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-905199df-c33d-428f-8fba-1cf92efa151c req-3b33d034-99ee-4070-965e-cb92473f4e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8a5c35-addb-48f1-928a-c53c742fbe4c", "name": "network-vif-deleted", "tag": "bfea540b-fd0e-472b-8c6b-76b61ec6c980"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:18:17.343833 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-905199df-c33d-428f-8fba-1cf92efa151c req-3b33d034-99ee-4070-965e-cb92473f4e4c service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:17.345935 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-905199df-c33d-428f-8fba-1cf92efa151c req-3b33d034-99ee-4070-965e-cb92473f4e4c service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:17.345935 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-905199df-c33d-428f-8fba-1cf92efa151c req-3b33d034-99ee-4070-965e-cb92473f4e4c service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:17.356579 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-905199df-c33d-428f-8fba-1cf92efa151c req-3b33d034-99ee-4070-965e-cb92473f4e4c service nova] Creating event network-vif-deleted:bfea540b-fd0e-472b-8c6b-76b61ec6c980 for instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c on hv-cinder-84496 Sep 14 12:18:17.362190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-905199df-c33d-428f-8fba-1cf92efa151c req-3b33d034-99ee-4070-965e-cb92473f4e4c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033571 Sep 14 12:18:17.362795 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 559/1112] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:17.932964 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:17.934319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:17.940405 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:17.940903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:17.941348 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:17.942093 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:17.942552 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:17.942985 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:17.977248 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:17.977809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:17.978231 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:17.978681 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lazy-loading 'fault' on Instance uuid 2a8a5c35-addb-48f1-928a-c53c742fbe4c {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:18:18.023048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:18.032347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:18.033964 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28e44067e07d4501a840108f4dcf053c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410170ed3ed4ce2b64d367cbf77790a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:18:18.035401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9d5a41e5-9f48-4bda-9863-61d48be2a50f tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 200 len: 1371 microversion: 2.20 time: 0.106563 Sep 14 12:18:18.036044 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 554/1113] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:18:17 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 12:18:19.061409 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:19.062212 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:19.068782 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:19.069266 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:19.069700 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:19.070417 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:19.070872 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:19.071367 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:19.084562 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] HTTP exception thrown: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Request method failure captured: Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c HTTP/1.1 Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOwDapskpoCqu5EFnt8nv7zDnixAUA_TemLf3fQlRz6qRE5K-yIEgqSGM8glrH9e04MCVU7qWBH7NuBSfBtlrH9m-gLGgoo-5YU4fV79tLIrcofYeMFmRxT1hNgIkCVxnJtMZBCN58seJOIquY3L4oytfH0QK1DMpeR2DN5Qn7YIdY Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:18:19.086176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}] Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 28e44067e07d4501a840108f4dcf053c Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:19.087987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '2a8a5c35-addb-48f1-928a-c53c742fbe4c'} Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:18:19.088799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:19.090681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:19.092132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Returning 404 to user: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:18:19.092132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e8a47e45-7047-49fa-9124-b38d70d1ebdf tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 404 len: 111 microversion: 2.20 time: 0.030529 Sep 14 12:18:19.092132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 560/1114] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:18:19 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 12:18:19.097040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d0ab973d-ad07-4a9d-b60b-5f2942267499 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '.version_select at 0x7f1c99d40dc0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:19.175320 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d0ab973d-ad07-4a9d-b60b-5f2942267499 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947154319" status: 204 len: 0 microversion: 2.20 time: 0.082134 Sep 14 12:18:19.175914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 555/1115] 10.222.0.62 () {60 vars in 1262 bytes} [Wed Sep 14 12:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947154319 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 12:18:23.275364 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:23.275864 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:23.282938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:23.283426 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:23.283941 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:23.284559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:23.285016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:23.285444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:23.298999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] HTTP exception thrown: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Request method failure captured: Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c HTTP/1.1 Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOwDapskpoCqu5EFnt8nv7zDnixAUA_TemLf3fQlRz6qRE5K-yIEgqSGM8glrH9e04MCVU7qWBH7NuBSfBtlrH9m-gLGgoo-5YU4fV79tLIrcofYeMFmRxT1hNgIkCVxnJtMZBCN58seJOIquY3L4oytfH0QK1DMpeR2DN5Qn7YIdY Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:18:23.300596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}] Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 28e44067e07d4501a840108f4dcf053c Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:23.302077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '2a8a5c35-addb-48f1-928a-c53c742fbe4c'} Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:18:23.303593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:23.304835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:23.306339 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Returning 404 to user: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:18:23.306339 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-fec6bb29-b9ea-47aa-87f2-6bbda847cc81 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 404 len: 111 microversion: 2.20 time: 0.030849 Sep 14 12:18:23.306339 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 561/1116] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Sep 14 12:18:23 2022] DELETE /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 12:18:23.310695 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:23.311367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: 2a8a5c35-addb-48f1-928a-c53c742fbe4c] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:23.320704 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:23.321297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:23.321738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:23.322474 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:23.322931 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:23.323357 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:23.337092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] HTTP exception thrown: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Request method failure captured: Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c HTTP/1.1 Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcOwDapskpoCqu5EFnt8nv7zDnixAUA_TemLf3fQlRz6qRE5K-yIEgqSGM8glrH9e04MCVU7qWBH7NuBSfBtlrH9m-gLGgoo-5YU4fV79tLIrcofYeMFmRxT1hNgIkCVxnJtMZBCN58seJOIquY3L4oytfH0QK1DMpeR2DN5Qn7YIdY Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:18:23.338802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}] Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 28e44067e07d4501a840108f4dcf053c Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:23.340902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '2a8a5c35-addb-48f1-928a-c53c742fbe4c'} Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:18:23.344524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. Sep 14 12:18:23.346155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:23.347595 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Returning 404 to user: Instance 2a8a5c35-addb-48f1-928a-c53c742fbe4c could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:18:23.347595 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bccb905f-659c-44fd-b14a-8d4b2765402d tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c" status: 404 len: 111 microversion: 2.20 time: 0.034183 Sep 14 12:18:23.347595 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 556/1117] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:18:23 2022] GET /compute/v2.1/servers/2a8a5c35-addb-48f1-928a-c53c742fbe4c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 12:18:24.633720 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:24.634402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:24.641444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:24.641955 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:24.647631 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:24.647631 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:24.647631 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:24.647631 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:24.658217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] HTTP exception thrown: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Request method failure captured: Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f HTTP/1.1 Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcOwDapskpoCqu5EFnt8nv7zDnixAUA_TemLf3fQlRz6qRE5K-yIEgqSGM8glrH9e04MCVU7qWBH7NuBSfBtlrH9m-gLGgoo-5YU4fV79tLIrcofYeMFmRxT1hNgIkCVxnJtMZBCN58seJOIquY3L4oytfH0QK1DMpeR2DN5Qn7YIdY Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:18:24.659885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}] Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 28e44067e07d4501a840108f4dcf053c Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:18:24.662818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'b7b1312a-8b45-4481-9a44-f330379d0c8f'} Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:18:24.664297 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:18:24.667052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:24.670491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Returning 404 to user: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:18:24.670491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-06fc7780-b3a7-442c-991a-38a3300d07d7 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 404 len: 111 microversion: 2.20 time: 0.031564 Sep 14 12:18:24.670491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 562/1118] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Sep 14 12:18:24 2022] DELETE /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 12:18:24.670942 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:24.671673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] [instance: b7b1312a-8b45-4481-9a44-f330379d0c8f] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:18:24.677846 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:24.678369 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:24.678812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:24.679510 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:18:24.679968 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:18:24.680404 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:18:24.695045 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] HTTP exception thrown: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Request method failure captured: Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f HTTP/1.1 Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcOwDapskpoCqu5EFnt8nv7zDnixAUA_TemLf3fQlRz6qRE5K-yIEgqSGM8glrH9e04MCVU7qWBH7NuBSfBtlrH9m-gLGgoo-5YU4fV79tLIrcofYeMFmRxT1hNgIkCVxnJtMZBCN58seJOIquY3L4oytfH0QK1DMpeR2DN5Qn7YIdY Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:18:24.696656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d410170ed3ed4ce2b64d367cbf77790a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d410170ed3ed4ce2b64d367cbf77790a"}]}] Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: d410170ed3ed4ce2b64d367cbf77790a Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1859857131 Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 28e44067e07d4501a840108f4dcf053c Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1859857131-project Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:18:24.698472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': 'b7b1312a-8b45-4481-9a44-f330379d0c8f'} Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:18:24.699485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. Sep 14 12:18:24.701092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:24.702605 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] Returning 404 to user: Instance b7b1312a-8b45-4481-9a44-f330379d0c8f could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:18:24.702605 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c9a59503-160f-4334-a459-774fa58d4ca8 tempest-AttachVolumeShelveTestJSON-1859857131 tempest-AttachVolumeShelveTestJSON-1859857131-project] 10.222.0.62 "GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f" status: 404 len: 111 microversion: 2.20 time: 0.031850 Sep 14 12:18:24.702605 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 557/1119] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Sep 14 12:18:24 2022] GET /compute/v2.1/servers/b7b1312a-8b45-4481-9a44-f330379d0c8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 12:18:30.743247 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4fd2fe0f-2433-47bc-bfc4-239c414dfd20 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Action: 'create', calling method: .version_select at 0x7f1c99b86670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2063592520"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:18:31.416593 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4fd2fe0f-2433-47bc-bfc4-239c414dfd20 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.808800 Sep 14 12:18:31.417888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 563/1120] 10.222.0.62 () {60 vars in 1155 bytes} [Wed Sep 14 12:18:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 811 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 14 12:18:31.432060 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-824bd4c7-3eee-4c87-b034-566554069502 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99f3fca0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:31.504507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-824bd4c7-3eee-4c87-b034-566554069502 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0" status: 200 len: 345 microversion: 2.1 time: 0.063782 Sep 14 12:18:31.504507 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 558/1121] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:18:31 2022] GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:32.507776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2f46d1c8-4038-47f9-841a-4b57ff5f21cd tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99dcf940>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:32.583887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2f46d1c8-4038-47f9-841a-4b57ff5f21cd tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0" status: 200 len: 346 microversion: 2.1 time: 0.081760 Sep 14 12:18:32.584959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 564/1122] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:18:32 2022] GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0 => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:32.599407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d5be4ec7-7bba-466f-a939-e326fc5d16a8 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Action: 'create', calling method: .version_select at 0x7f1c99d37940>, body: {"snapshot": {"volume_id": "100224e0-800c-4b37-87f8-f1b23f0b3ab0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-869230794"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:18:33.163652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d5be4ec7-7bba-466f-a939-e326fc5d16a8 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.568413 Sep 14 12:18:33.168429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 559/1123] 10.222.0.62 () {60 vars in 1162 bytes} [Wed Sep 14 12:18:32 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:18:33.180874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6a26f0ba-e6fb-4955-abfa-854ad1093708 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99d03a60>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:33.227292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6a26f0ba-e6fb-4955-abfa-854ad1093708 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf" status: 200 len: 286 microversion: 2.1 time: 0.050601 Sep 14 12:18:33.228326 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 565/1124] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 14 12:18:33 2022] GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:33.240393 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-446c0cf8-7429-4783-b756-65aafa01f2c2 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99cc8ca0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:33.278617 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-446c0cf8-7429-4783-b756-65aafa01f2c2 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.042567 Sep 14 12:18:33.279223 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 560/1125] 10.222.0.62 () {58 vars in 1140 bytes} [Wed Sep 14 12:18:33 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:18:33.291187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d98cfa2a-a3a8-416f-a217-d56f64606830 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99d03700>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:33.321989 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d98cfa2a-a3a8-416f-a217-d56f64606830 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf" status: 200 len: 286 microversion: 2.1 time: 0.034752 Sep 14 12:18:33.326470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 566/1126] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 14 12:18:33 2022] GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:34.336198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-29333626-3fe5-4419-9b41-6b5c4f37b0a9 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99d78040>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:34.377706 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-29333626-3fe5-4419-9b41-6b5c4f37b0a9 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf" status: 200 len: 286 microversion: 2.1 time: 0.045914 Sep 14 12:18:34.378483 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 561/1127] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 14 12:18:34 2022] GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:35.391524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:35.392265 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:35.396153 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6dd27923-eca2-434a-89da-f87c5da4d1d9 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c9a101ee0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:35.435334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6dd27923-eca2-434a-89da-f87c5da4d1d9 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf" status: 200 len: 286 microversion: 2.1 time: 0.045165 Sep 14 12:18:35.435909 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 567/1128] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 14 12:18:35 2022] GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:36.452057 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:36.452996 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=30 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:36.457352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e5be6c1e-821f-4e7b-a31b-2213c5a8d0cb tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99d81f70>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:36.516776 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e5be6c1e-821f-4e7b-a31b-2213c5a8d0cb tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf" status: 200 len: 286 microversion: 2.1 time: 0.065371 Sep 14 12:18:36.517951 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 562/1129] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 14 12:18:36 2022] GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:37.530791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2615ed0c-df1c-4982-9ca2-d881a17a8727 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99d11ee0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:37.595122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2615ed0c-df1c-4982-9ca2-d881a17a8727 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf" status: 200 len: 287 microversion: 2.1 time: 0.068780 Sep 14 12:18:37.595695 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 568/1130] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 14 12:18:37 2022] GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:37.608599 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-eb585ffe-8635-48d8-a6bf-d8659c4dccfa tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c9aa4ddc0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:37.745368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-eb585ffe-8635-48d8-a6bf-d8659c4dccfa tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf" status: 202 len: 0 microversion: 2.1 time: 0.140414 Sep 14 12:18:37.746086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 563/1131] 10.222.0.62 () {58 vars in 1254 bytes} [Wed Sep 14 12:18:37 2022] DELETE /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:18:37.756378 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-47317bb1-ecb2-4a1b-aeec-486b30e06088 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99dcf4c0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:37.793303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-47317bb1-ecb2-4a1b-aeec-486b30e06088 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf" status: 200 len: 286 microversion: 2.1 time: 0.041950 Sep 14 12:18:37.799167 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 569/1132] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 14 12:18:37 2022] GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:38.808091 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7498aec4-a351-4735-8be7-facdfa946676 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99f3f4c0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:38.852221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-7498aec4-a351-4735-8be7-facdfa946676 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] HTTP exception thrown: Snapshot de76356b-45c3-43c4-96a3-d81c860866bf could not be found. Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7498aec4-a351-4735-8be7-facdfa946676 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Request method failure captured: Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf HTTP/1.1 Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcaWdmB6R8nZw0lH-XvSAyx0xXE7Sh3ZD9eG57GFJIramjZNgJUbms5m3f37cYlp58OZIQqqlkNLmzW3-xj7HXW6MZnXXbAG9NbY2SAEM0JCmXRSqr0i6ZazEdk16AicHE2MjpKBxZNE78GN40Q3tsOx0k6Me_poaVIRbQ08NsG7VdI Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 834a2513fbef4bef831947a0345832f1 Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:18:38.857803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/834a2513fbef4bef831947a0345832f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/834a2513fbef4bef831947a0345832f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_834a2513fbef4bef831947a0345832f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/834a2513fbef4bef831947a0345832f1"}]}] Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 834a2513fbef4bef831947a0345832f1 Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-VolumesSnapshotsTestJSON-213082124-project Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: da4779b17adb478f8ba0e359aa08a5bb Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-VolumesSnapshotsTestJSON-213082124-project Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Snapshot de76356b-45c3-43c4-96a3-d81c860866bf could not be found. Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': 'de76356b-45c3-43c4-96a3-d81c860866bf'} Sep 14 12:18:38.859611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot de76356b-45c3-43c4-96a3-d81c860866bf could not be found. (HTTP 404) (Request-ID: req-d4e69a43-3f13-4f32-9917-a0e68d9dc4f4) Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:38.860648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 12:18:38.863050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot de76356b-45c3-43c4-96a3-d81c860866bf could not be found. Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 14 12:18:38.864347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot de76356b-45c3-43c4-96a3-d81c860866bf could not be found. Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot de76356b-45c3-43c4-96a3-d81c860866bf could not be found. Sep 14 12:18:38.865916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:38.868239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7498aec4-a351-4735-8be7-facdfa946676 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Returning 404 to user: Snapshot de76356b-45c3-43c4-96a3-d81c860866bf could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:18:38.869389 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7498aec4-a351-4735-8be7-facdfa946676 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf" status: 404 len: 111 microversion: 2.1 time: 0.066764 Sep 14 12:18:38.873392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 564/1133] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Sep 14 12:18:38 2022] GET /compute/v2.1/os-snapshots/de76356b-45c3-43c4-96a3-d81c860866bf => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:18:38.880227 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-464da7b1-fa4d-4365-9bd0-60982906f2b4 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99eba1f0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:39.119240 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-464da7b1-fa4d-4365-9bd0-60982906f2b4 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0" status: 202 len: 0 microversion: 2.1 time: 0.243751 Sep 14 12:18:39.119907 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 570/1134] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 14 12:18:38 2022] DELETE /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:18:39.130540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3261cb36-0d49-4175-b866-cb6d12319854 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99cc8ca0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:39.182052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3261cb36-0d49-4175-b866-cb6d12319854 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0" status: 200 len: 345 microversion: 2.1 time: 0.056416 Sep 14 12:18:39.183262 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 565/1135] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:18:39 2022] GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:18:40.207454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ffe070f2-6d17-4e19-a408-d2cf29b54082 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99d20550>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:40.246045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-ffe070f2-6d17-4e19-a408-d2cf29b54082 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] HTTP exception thrown: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ffe070f2-6d17-4e19-a408-d2cf29b54082 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Request method failure captured: Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0 HTTP/1.1 Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcaWdmB6R8nZw0lH-XvSAyx0xXE7Sh3ZD9eG57GFJIramjZNgJUbms5m3f37cYlp58OZIQqqlkNLmzW3-xj7HXW6MZnXXbAG9NbY2SAEM0JCmXRSqr0i6ZazEdk16AicHE2MjpKBxZNE78GN40Q3tsOx0k6Me_poaVIRbQ08NsG7VdI Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 834a2513fbef4bef831947a0345832f1 Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:18:40.248353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/834a2513fbef4bef831947a0345832f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/834a2513fbef4bef831947a0345832f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_834a2513fbef4bef831947a0345832f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/834a2513fbef4bef831947a0345832f1"}]}] Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 834a2513fbef4bef831947a0345832f1 Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesSnapshotsTestJSON-213082124-project Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: da4779b17adb478f8ba0e359aa08a5bb Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesSnapshotsTestJSON-213082124-project Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '100224e0-800c-4b37-87f8-f1b23f0b3ab0'} Sep 14 12:18:40.250044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. (HTTP 404) (Request-ID: req-8ba5d71e-e033-423e-81dc-1ab878fff3c5) Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:40.251129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 12:18:40.252524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 12:18:40.254713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ffe070f2-6d17-4e19-a408-d2cf29b54082 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Returning 404 to user: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:18:40.258421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ffe070f2-6d17-4e19-a408-d2cf29b54082 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0" status: 404 len: 109 microversion: 2.1 time: 0.057786 Sep 14 12:18:40.260863 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 571/1136] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:18:40 2022] GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:18:40.267432 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-db45f701-86ce-4ccb-af98-716bcae879c8 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99d78f70>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:40.299365 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-db45f701-86ce-4ccb-af98-716bcae879c8 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] HTTP exception thrown: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-db45f701-86ce-4ccb-af98-716bcae879c8 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Request method failure captured: Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: DELETE /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0 HTTP/1.1 Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcaWdmB6R8nZw0lH-XvSAyx0xXE7Sh3ZD9eG57GFJIramjZNgJUbms5m3f37cYlp58OZIQqqlkNLmzW3-xj7HXW6MZnXXbAG9NbY2SAEM0JCmXRSqr0i6ZazEdk16AicHE2MjpKBxZNE78GN40Q3tsOx0k6Me_poaVIRbQ08NsG7VdI Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 834a2513fbef4bef831947a0345832f1 Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:18:40.302269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/834a2513fbef4bef831947a0345832f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/834a2513fbef4bef831947a0345832f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_834a2513fbef4bef831947a0345832f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/834a2513fbef4bef831947a0345832f1"}]}] Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 834a2513fbef4bef831947a0345832f1 Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-VolumesSnapshotsTestJSON-213082124-project Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: da4779b17adb478f8ba0e359aa08a5bb Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-VolumesSnapshotsTestJSON-213082124-project Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '100224e0-800c-4b37-87f8-f1b23f0b3ab0'} Sep 14 12:18:40.303870 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. (HTTP 404) (Request-ID: req-b7010b0c-9357-4874-8ce0-356a1dacac0e) Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:40.304840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 12:18:40.306915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 12:18:40.308158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-db45f701-86ce-4ccb-af98-716bcae879c8 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Returning 404 to user: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-db45f701-86ce-4ccb-af98-716bcae879c8 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0" status: 404 len: 109 microversion: 2.1 time: 0.042292 Sep 14 12:18:40.309384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 566/1137] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 14 12:18:40 2022] DELETE /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:18:40.319274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-aaedf042-daa6-48ef-aedb-42b21eb64b64 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Calling method '.version_select at 0x7f1c99d11b80>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:18:40.350033 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-aaedf042-daa6-48ef-aedb-42b21eb64b64 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] HTTP exception thrown: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-aaedf042-daa6-48ef-aedb-42b21eb64b64 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Request method failure captured: Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0 HTTP/1.1 Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcaWdmB6R8nZw0lH-XvSAyx0xXE7Sh3ZD9eG57GFJIramjZNgJUbms5m3f37cYlp58OZIQqqlkNLmzW3-xj7HXW6MZnXXbAG9NbY2SAEM0JCmXRSqr0i6ZazEdk16AicHE2MjpKBxZNE78GN40Q3tsOx0k6Me_poaVIRbQ08NsG7VdI Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 834a2513fbef4bef831947a0345832f1 Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:18:40.352016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/834a2513fbef4bef831947a0345832f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/834a2513fbef4bef831947a0345832f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_834a2513fbef4bef831947a0345832f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/834a2513fbef4bef831947a0345832f1"}]}] Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 834a2513fbef4bef831947a0345832f1 Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-213082124 Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesSnapshotsTestJSON-213082124-project Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: da4779b17adb478f8ba0e359aa08a5bb Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesSnapshotsTestJSON-213082124-project Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '100224e0-800c-4b37-87f8-f1b23f0b3ab0'} Sep 14 12:18:40.353359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. (HTTP 404) (Request-ID: req-8e81b536-d729-4363-85cb-f5e0f77f755f) Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:40.354224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 12:18:40.356009 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 12:18:40.357160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-aaedf042-daa6-48ef-aedb-42b21eb64b64 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] Returning 404 to user: Volume 100224e0-800c-4b37-87f8-f1b23f0b3ab0 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-aaedf042-daa6-48ef-aedb-42b21eb64b64 tempest-VolumesSnapshotsTestJSON-213082124 tempest-VolumesSnapshotsTestJSON-213082124-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0" status: 404 len: 109 microversion: 2.1 time: 0.038406 Sep 14 12:18:40.358331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 572/1138] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Sep 14 12:18:40 2022] GET /compute/v2.1/os-volumes/100224e0-800c-4b37-87f8-f1b23f0b3ab0 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:18:40.563710 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-78ba6f19-5144-4711-b085-045a06a9d733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Action: 'create', calling method: .version_select at 0x7f1c9d357310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1546583045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqhcAhuu7XRaHZuqYtq3zkUYfNsHy9vuWMSgfCqrJrQTRZ2AInPsECMp/3dqT17Czrb29gevTnbwDvfnz7UpoFZg5UB4j2loGc8QDHpno5gzcMQKrC9phDPc7t0ODgarw=="}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:18:40.581119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-78ba6f19-5144-4711-b085-045a06a9d733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Getting quotas for project 9204365716924bbebdc0d90ecc13d01e. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:18:40.585317 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-78ba6f19-5144-4711-b085-045a06a9d733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Getting quotas for user 3b11628831fe4f50a7f9997c1f213a71 and project 9204365716924bbebdc0d90ecc13d01e. Resources: {'key_pairs'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:18:40.690237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-78ba6f19-5144-4711-b085-045a06a9d733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.329856 Sep 14 12:18:40.690850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 567/1139] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 14 12:18:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:19:07.783606 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-897984325", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1546583045", "security_groups": [{"name": "tempest-secgroup-smoke-515319990"}], "networks": [{"uuid": "e8e2ad3c-4f2a-4ccb-b613-ddac0a9c70c7"}], "block_device_mapping_v2": [{"uuid": "7b93c4cf-a0fc-4dc6-b307-e51b20fe8bf7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:19:08.249024 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.network.neutron [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] validate_networks() for [('e8e2ad3c-4f2a-4ccb-b613-ddac0a9c70c7', None, None, None, None, None)] {{(pid=121152) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:19:08.915662 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Flavor limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:19:08.916260 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Image limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:19:08.916771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Flavor pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:19:08.917285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Image pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:19:08.917823 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:19:08.928248 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:08.928927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:08.929355 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:08.930166 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:08.930619 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:08.931073 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:08.952615 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Getting quotas for project 9204365716924bbebdc0d90ecc13d01e. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:19:08.956916 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Getting quotas for user 3b11628831fe4f50a7f9997c1f213a71 and project 9204365716924bbebdc0d90ecc13d01e. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:19:09.018531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Going to run 1 instances... {{(pid=121152) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:19:09.018531 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b93c4cf-a0fc-4dc6-b307-e51b20fe8bf7',volume_size=None,volume_type=None)] {{(pid=121152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:19:09.443141 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR oslo.messaging._drivers.impl_rabbit [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [5fa93e0e-1ad3-48c3-abbc-3b984d7abb4d] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 12:19:10.449753 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO oslo.messaging._drivers.impl_rabbit [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [5fa93e0e-1ad3-48c3-abbc-3b984d7abb4d] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 57538. Sep 14 12:19:10.458669 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-444e7bfe-5247-473c-a73f-7259ec62e071 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.681727 Sep 14 12:19:10.471432 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9f9e5139-071b-4b01-a1d3-aed641cd313f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:10.472052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9f9e5139-071b-4b01-a1d3-aed641cd313f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:10.475257 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=4 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:10.475444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:10.477413 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 573/1140] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:19:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 12:19:10.533256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9f9e5139-071b-4b01-a1d3-aed641cd313f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:10.542108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9f9e5139-071b-4b01-a1d3-aed641cd313f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1088 microversion: 2.1 time: 0.074730 Sep 14 12:19:10.543071 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 568/1141] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:10 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:19:11.568204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-59c882dc-18f9-4109-b98d-a0c45c12f4dd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:11.568825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-59c882dc-18f9-4109-b98d-a0c45c12f4dd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:11.624627 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-59c882dc-18f9-4109-b98d-a0c45c12f4dd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:11.631808 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-59c882dc-18f9-4109-b98d-a0c45c12f4dd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1088 microversion: 2.1 time: 0.068091 Sep 14 12:19:11.645471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 574/1142] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:11 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:12.656248 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f6035497-e750-49e0-bbc7-132ab038a252 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:12.656951 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f6035497-e750-49e0-bbc7-132ab038a252 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:12.665821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6035497-e750-49e0-bbc7-132ab038a252 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:12.665821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6035497-e750-49e0-bbc7-132ab038a252 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:12.665821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6035497-e750-49e0-bbc7-132ab038a252 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:12.666416 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6035497-e750-49e0-bbc7-132ab038a252 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:12.666875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6035497-e750-49e0-bbc7-132ab038a252 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:12.667305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6035497-e750-49e0-bbc7-132ab038a252 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:12.737171 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f6035497-e750-49e0-bbc7-132ab038a252 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:12.744914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f6035497-e750-49e0-bbc7-132ab038a252 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1186 microversion: 2.1 time: 0.092923 Sep 14 12:19:12.745476 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 569/1143] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:12 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:13.768265 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d6d0e725-6ac9-4418-a722-b722f43f5794 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:13.768871 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d6d0e725-6ac9-4418-a722-b722f43f5794 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:13.776189 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6d0e725-6ac9-4418-a722-b722f43f5794 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:13.776760 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6d0e725-6ac9-4418-a722-b722f43f5794 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:13.777243 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6d0e725-6ac9-4418-a722-b722f43f5794 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:13.778257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6d0e725-6ac9-4418-a722-b722f43f5794 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:13.778463 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6d0e725-6ac9-4418-a722-b722f43f5794 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:13.778974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d6d0e725-6ac9-4418-a722-b722f43f5794 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:13.984035 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d6d0e725-6ac9-4418-a722-b722f43f5794 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:13.993674 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d6d0e725-6ac9-4418-a722-b722f43f5794 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1271 microversion: 2.1 time: 0.229306 Sep 14 12:19:13.994402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 575/1144] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:13 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1271 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:14.949832 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-caa5d820-8b4e-4744-8956-ae4abd2dbbe7 req-befcb4e7-3fb3-4b17-961c-dd3000a04b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921553b2-7c2b-4ec6-80c9-23298af50994", "tag": "f37c6abe-5567-400c-b0bd-04c3772b1a60"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:19:14.966619 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-caa5d820-8b4e-4744-8956-ae4abd2dbbe7 req-befcb4e7-3fb3-4b17-961c-dd3000a04b27 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:14.967877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-caa5d820-8b4e-4744-8956-ae4abd2dbbe7 req-befcb4e7-3fb3-4b17-961c-dd3000a04b27 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:14.968873 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-caa5d820-8b4e-4744-8956-ae4abd2dbbe7 req-befcb4e7-3fb3-4b17-961c-dd3000a04b27 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:14.983421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-caa5d820-8b4e-4744-8956-ae4abd2dbbe7 req-befcb4e7-3fb3-4b17-961c-dd3000a04b27 service nova] Creating event network-changed:f37c6abe-5567-400c-b0bd-04c3772b1a60 for instance 921553b2-7c2b-4ec6-80c9-23298af50994 on hv-cinder-84496 Sep 14 12:19:14.989096 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-caa5d820-8b4e-4744-8956-ae4abd2dbbe7 req-befcb4e7-3fb3-4b17-961c-dd3000a04b27 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044605 Sep 14 12:19:14.990704 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 570/1145] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:19:15.020273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-549ab554-5b92-408f-bad9-d603341ba4df tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:15.021264 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-549ab554-5b92-408f-bad9-d603341ba4df tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:15.028712 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-549ab554-5b92-408f-bad9-d603341ba4df tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:15.029194 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-549ab554-5b92-408f-bad9-d603341ba4df tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:15.029627 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-549ab554-5b92-408f-bad9-d603341ba4df tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:15.031066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-549ab554-5b92-408f-bad9-d603341ba4df tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:15.031717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-549ab554-5b92-408f-bad9-d603341ba4df tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:15.032148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-549ab554-5b92-408f-bad9-d603341ba4df tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:15.277633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-549ab554-5b92-408f-bad9-d603341ba4df tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:15.287423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-549ab554-5b92-408f-bad9-d603341ba4df tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1271 microversion: 2.1 time: 0.271147 Sep 14 12:19:15.292944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 576/1146] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:15 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:16.310280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4f6826dc-6870-448b-bd99-1e345fe36516 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:16.310902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4f6826dc-6870-448b-bd99-1e345fe36516 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:16.317310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f6826dc-6870-448b-bd99-1e345fe36516 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:16.317788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f6826dc-6870-448b-bd99-1e345fe36516 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:16.318259 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f6826dc-6870-448b-bd99-1e345fe36516 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:16.318948 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f6826dc-6870-448b-bd99-1e345fe36516 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:16.319402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f6826dc-6870-448b-bd99-1e345fe36516 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:16.319832 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4f6826dc-6870-448b-bd99-1e345fe36516 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:16.456429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4f6826dc-6870-448b-bd99-1e345fe36516 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:16.464947 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4f6826dc-6870-448b-bd99-1e345fe36516 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.159641 Sep 14 12:19:16.466035 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 571/1147] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:16 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:17.498617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-dbf19602-98b9-4a44-a3ee-52b56e96c13f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:17.499286 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-dbf19602-98b9-4a44-a3ee-52b56e96c13f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:17.505129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dbf19602-98b9-4a44-a3ee-52b56e96c13f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:17.505623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dbf19602-98b9-4a44-a3ee-52b56e96c13f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:17.506106 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dbf19602-98b9-4a44-a3ee-52b56e96c13f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:17.506799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dbf19602-98b9-4a44-a3ee-52b56e96c13f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:17.507255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dbf19602-98b9-4a44-a3ee-52b56e96c13f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:17.507678 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-dbf19602-98b9-4a44-a3ee-52b56e96c13f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:17.659477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-dbf19602-98b9-4a44-a3ee-52b56e96c13f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:17.667273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-dbf19602-98b9-4a44-a3ee-52b56e96c13f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.175407 Sep 14 12:19:17.667853 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 577/1148] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:17 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:18.692605 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-91e5ea47-5ce8-4ee7-84b0-c1fa06650565 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:18.692605 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-91e5ea47-5ce8-4ee7-84b0-c1fa06650565 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:18.698619 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e5ea47-5ce8-4ee7-84b0-c1fa06650565 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:18.699109 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e5ea47-5ce8-4ee7-84b0-c1fa06650565 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:18.699549 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e5ea47-5ce8-4ee7-84b0-c1fa06650565 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:18.700792 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e5ea47-5ce8-4ee7-84b0-c1fa06650565 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:18.701246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e5ea47-5ce8-4ee7-84b0-c1fa06650565 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:18.701673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-91e5ea47-5ce8-4ee7-84b0-c1fa06650565 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:18.841415 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-91e5ea47-5ce8-4ee7-84b0-c1fa06650565 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:18.849339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-91e5ea47-5ce8-4ee7-84b0-c1fa06650565 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.161922 Sep 14 12:19:18.849940 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 572/1149] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:18 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:19.873000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2d66f55e-3ee8-4bee-b734-c68b363267ab tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:19.873715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2d66f55e-3ee8-4bee-b734-c68b363267ab tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:19.876279 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:19.881246 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d66f55e-3ee8-4bee-b734-c68b363267ab tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:19.881730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d66f55e-3ee8-4bee-b734-c68b363267ab tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:19.882193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d66f55e-3ee8-4bee-b734-c68b363267ab tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:19.882886 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d66f55e-3ee8-4bee-b734-c68b363267ab tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:19.883333 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d66f55e-3ee8-4bee-b734-c68b363267ab tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:19.883751 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d66f55e-3ee8-4bee-b734-c68b363267ab tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:20.029254 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d66f55e-3ee8-4bee-b734-c68b363267ab tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:20.037093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2d66f55e-3ee8-4bee-b734-c68b363267ab tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.168030 Sep 14 12:19:20.037672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 578/1150] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:19 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:21.060408 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7805fd31-65eb-4f70-87f4-7b6964c2ed95 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:21.061605 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7805fd31-65eb-4f70-87f4-7b6964c2ed95 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:21.064265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:21.069225 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7805fd31-65eb-4f70-87f4-7b6964c2ed95 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:21.069721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7805fd31-65eb-4f70-87f4-7b6964c2ed95 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:21.070302 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7805fd31-65eb-4f70-87f4-7b6964c2ed95 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:21.071045 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7805fd31-65eb-4f70-87f4-7b6964c2ed95 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:21.071506 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7805fd31-65eb-4f70-87f4-7b6964c2ed95 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:21.071935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7805fd31-65eb-4f70-87f4-7b6964c2ed95 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:21.236279 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7805fd31-65eb-4f70-87f4-7b6964c2ed95 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:21.249791 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7805fd31-65eb-4f70-87f4-7b6964c2ed95 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.193225 Sep 14 12:19:21.264896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 573/1151] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:21 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:22.277268 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8fa1ca37-fae5-4480-974b-48ad9ec1e733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:22.277905 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8fa1ca37-fae5-4480-974b-48ad9ec1e733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:22.286337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=8 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:22.288900 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fa1ca37-fae5-4480-974b-48ad9ec1e733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:22.289629 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fa1ca37-fae5-4480-974b-48ad9ec1e733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:22.290318 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fa1ca37-fae5-4480-974b-48ad9ec1e733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:22.291211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fa1ca37-fae5-4480-974b-48ad9ec1e733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:22.291836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fa1ca37-fae5-4480-974b-48ad9ec1e733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:22.294280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8fa1ca37-fae5-4480-974b-48ad9ec1e733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:22.469930 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8fa1ca37-fae5-4480-974b-48ad9ec1e733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:22.482171 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8fa1ca37-fae5-4480-974b-48ad9ec1e733 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.208803 Sep 14 12:19:22.482831 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 579/1152] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:22 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:23.505417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3b7b3428-7f69-49be-a8b3-d308f2065eee tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:23.506085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3b7b3428-7f69-49be-a8b3-d308f2065eee tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:23.514233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b7b3428-7f69-49be-a8b3-d308f2065eee tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:23.516662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b7b3428-7f69-49be-a8b3-d308f2065eee tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:23.516662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b7b3428-7f69-49be-a8b3-d308f2065eee tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:23.516662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b7b3428-7f69-49be-a8b3-d308f2065eee tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:23.517154 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b7b3428-7f69-49be-a8b3-d308f2065eee tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:23.517400 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3b7b3428-7f69-49be-a8b3-d308f2065eee tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:23.677628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3b7b3428-7f69-49be-a8b3-d308f2065eee tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:23.686770 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3b7b3428-7f69-49be-a8b3-d308f2065eee tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.185235 Sep 14 12:19:23.688584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 574/1153] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:23 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:24.712046 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ee0e5e99-f9d9-4003-a273-ce4149018e87 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:24.712631 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ee0e5e99-f9d9-4003-a273-ce4149018e87 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:24.720822 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e99-f9d9-4003-a273-ce4149018e87 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:24.721316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e99-f9d9-4003-a273-ce4149018e87 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:24.721736 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e99-f9d9-4003-a273-ce4149018e87 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:24.722640 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e99-f9d9-4003-a273-ce4149018e87 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:24.723248 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e99-f9d9-4003-a273-ce4149018e87 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:24.724007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ee0e5e99-f9d9-4003-a273-ce4149018e87 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:24.907259 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ee0e5e99-f9d9-4003-a273-ce4149018e87 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:24.916412 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ee0e5e99-f9d9-4003-a273-ce4149018e87 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.208066 Sep 14 12:19:24.924128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 580/1154] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:24 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:25.945452 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c1d58b26-93ec-41e5-b213-a97428027e64 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:25.946359 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c1d58b26-93ec-41e5-b213-a97428027e64 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:25.953768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1d58b26-93ec-41e5-b213-a97428027e64 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:25.954353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1d58b26-93ec-41e5-b213-a97428027e64 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:25.954797 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1d58b26-93ec-41e5-b213-a97428027e64 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:25.955518 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1d58b26-93ec-41e5-b213-a97428027e64 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:25.955978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1d58b26-93ec-41e5-b213-a97428027e64 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:25.956409 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c1d58b26-93ec-41e5-b213-a97428027e64 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:26.156526 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c1d58b26-93ec-41e5-b213-a97428027e64 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:26.170838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c1d58b26-93ec-41e5-b213-a97428027e64 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.231217 Sep 14 12:19:26.188172 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 575/1155] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:25 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:27.015792 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-1b75707c-b046-4a42-ac2c-e3fef7eff377 req-1f5b211a-05be-4371-b458-26d313929c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921553b2-7c2b-4ec6-80c9-23298af50994", "name": "network-vif-plugged", "status": "completed", "tag": "f37c6abe-5567-400c-b0bd-04c3772b1a60"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:19:27.029693 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-1b75707c-b046-4a42-ac2c-e3fef7eff377 req-1f5b211a-05be-4371-b458-26d313929c47 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:27.029693 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-1b75707c-b046-4a42-ac2c-e3fef7eff377 req-1f5b211a-05be-4371-b458-26d313929c47 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:27.030960 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-1b75707c-b046-4a42-ac2c-e3fef7eff377 req-1f5b211a-05be-4371-b458-26d313929c47 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:27.042537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-1b75707c-b046-4a42-ac2c-e3fef7eff377 req-1f5b211a-05be-4371-b458-26d313929c47 service nova] Creating event network-vif-plugged:f37c6abe-5567-400c-b0bd-04c3772b1a60 for instance 921553b2-7c2b-4ec6-80c9-23298af50994 on hv-cinder-84496 Sep 14 12:19:27.048161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-1b75707c-b046-4a42-ac2c-e3fef7eff377 req-1f5b211a-05be-4371-b458-26d313929c47 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037598 Sep 14 12:19:27.048744 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 581/1156] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:19:27.196518 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-426aeca4-f035-47cc-a14b-c2911ebc30e6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:27.197876 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-426aeca4-f035-47cc-a14b-c2911ebc30e6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:27.206648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-426aeca4-f035-47cc-a14b-c2911ebc30e6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:27.212206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-426aeca4-f035-47cc-a14b-c2911ebc30e6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:27.212206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-426aeca4-f035-47cc-a14b-c2911ebc30e6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:27.212206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-426aeca4-f035-47cc-a14b-c2911ebc30e6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:27.212206 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-426aeca4-f035-47cc-a14b-c2911ebc30e6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:27.214355 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-426aeca4-f035-47cc-a14b-c2911ebc30e6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:27.482619 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-426aeca4-f035-47cc-a14b-c2911ebc30e6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:27.495344 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-426aeca4-f035-47cc-a14b-c2911ebc30e6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.300545 Sep 14 12:19:27.495344 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 576/1157] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:27 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:28.530547 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9a82ba6a-eb2a-4ba8-b4cd-a2265751e36b tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:28.549322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9a82ba6a-eb2a-4ba8-b4cd-a2265751e36b tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:28.549322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a82ba6a-eb2a-4ba8-b4cd-a2265751e36b tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:28.549322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a82ba6a-eb2a-4ba8-b4cd-a2265751e36b tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:28.549322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a82ba6a-eb2a-4ba8-b4cd-a2265751e36b tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:28.550487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a82ba6a-eb2a-4ba8-b4cd-a2265751e36b tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:28.550487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a82ba6a-eb2a-4ba8-b4cd-a2265751e36b tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:28.550487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9a82ba6a-eb2a-4ba8-b4cd-a2265751e36b tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:28.709418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9a82ba6a-eb2a-4ba8-b4cd-a2265751e36b tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:28.718478 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9a82ba6a-eb2a-4ba8-b4cd-a2265751e36b tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1259 microversion: 2.1 time: 0.194284 Sep 14 12:19:28.719395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 582/1158] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:28 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:29.747802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9fcaea16-05f2-4d96-a94c-a14d41e09420 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:29.748470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9fcaea16-05f2-4d96-a94c-a14d41e09420 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:29.759335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fcaea16-05f2-4d96-a94c-a14d41e09420 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:29.760862 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fcaea16-05f2-4d96-a94c-a14d41e09420 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:29.760862 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fcaea16-05f2-4d96-a94c-a14d41e09420 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:29.761235 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fcaea16-05f2-4d96-a94c-a14d41e09420 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:29.761386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fcaea16-05f2-4d96-a94c-a14d41e09420 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:29.767717 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9fcaea16-05f2-4d96-a94c-a14d41e09420 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:29.990757 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9fcaea16-05f2-4d96-a94c-a14d41e09420 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:30.006740 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9fcaea16-05f2-4d96-a94c-a14d41e09420 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1443 microversion: 2.1 time: 0.266901 Sep 14 12:19:30.016903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 577/1159] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:29 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1443 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:30.049285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cc53e9b0-81d4-4feb-9ba3-9d553d66de28 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:30.052826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cc53e9b0-81d4-4feb-9ba3-9d553d66de28 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:30.074633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc53e9b0-81d4-4feb-9ba3-9d553d66de28 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:30.075615 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc53e9b0-81d4-4feb-9ba3-9d553d66de28 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:30.076352 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc53e9b0-81d4-4feb-9ba3-9d553d66de28 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:30.078289 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc53e9b0-81d4-4feb-9ba3-9d553d66de28 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:30.092780 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc53e9b0-81d4-4feb-9ba3-9d553d66de28 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:30.093272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cc53e9b0-81d4-4feb-9ba3-9d553d66de28 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:30.353917 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cc53e9b0-81d4-4feb-9ba3-9d553d66de28 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:30.367841 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cc53e9b0-81d4-4feb-9ba3-9d553d66de28 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1443 microversion: 2.1 time: 0.327203 Sep 14 12:19:30.386448 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 583/1160] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:30 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1443 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:31.437376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7ffd6cc9-b30a-4278-a9ff-aed913c86ce9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:31.439421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7ffd6cc9-b30a-4278-a9ff-aed913c86ce9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:31.452305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ffd6cc9-b30a-4278-a9ff-aed913c86ce9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:31.452305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ffd6cc9-b30a-4278-a9ff-aed913c86ce9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:31.452305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ffd6cc9-b30a-4278-a9ff-aed913c86ce9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:31.455093 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ffd6cc9-b30a-4278-a9ff-aed913c86ce9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:31.457628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ffd6cc9-b30a-4278-a9ff-aed913c86ce9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:31.458447 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ffd6cc9-b30a-4278-a9ff-aed913c86ce9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:31.502847 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7ffd6cc9-b30a-4278-a9ff-aed913c86ce9 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/ips" status: 200 len: 150 microversion: 2.1 time: 0.390299 Sep 14 12:19:31.503804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 578/1161] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Sep 14 12:19:31 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/ips => generated 150 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:19:32.936898 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-057db78c-df9e-4c34-a022-960c788ac24b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Action: 'create', calling method: .version_select at 0x7f1c99c448b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1225028685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtOn7udsWcMQPjDOHiGZyhQ585p9stQosRVDo8rFmEdgHYZnmul8YEAE2t+uFJujB9nDOfkYj0n2FSsPS63KVA82l5R2b3uvLT9rDMrVp70rkpma5IKkURIMIsNd75kmA=="}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:19:32.954845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-057db78c-df9e-4c34-a022-960c788ac24b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Getting quotas for project e0cdab1c080d4132adc6cd64d8627c68. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:19:32.961434 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-057db78c-df9e-4c34-a022-960c788ac24b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Getting quotas for user 33f480ef1b8b49df83276a66f445ae85 and project e0cdab1c080d4132adc6cd64d8627c68. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:19:33.066763 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-057db78c-df9e-4c34-a022-960c788ac24b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.294394 Sep 14 12:19:33.067872 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 584/1162] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 14 12:19:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:19:33.900765 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-4cef67e1-a867-4755-91d8-509c81c44a0d req-6afa679f-d1cf-4510-8cdf-1c805455888a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921553b2-7c2b-4ec6-80c9-23298af50994", "tag": "f37c6abe-5567-400c-b0bd-04c3772b1a60"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:19:33.917932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-4cef67e1-a867-4755-91d8-509c81c44a0d req-6afa679f-d1cf-4510-8cdf-1c805455888a service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:33.918805 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-4cef67e1-a867-4755-91d8-509c81c44a0d req-6afa679f-d1cf-4510-8cdf-1c805455888a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:33.919435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-4cef67e1-a867-4755-91d8-509c81c44a0d req-6afa679f-d1cf-4510-8cdf-1c805455888a service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:33.935739 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-4cef67e1-a867-4755-91d8-509c81c44a0d req-6afa679f-d1cf-4510-8cdf-1c805455888a service nova] Creating event network-changed:f37c6abe-5567-400c-b0bd-04c3772b1a60 for instance 921553b2-7c2b-4ec6-80c9-23298af50994 on hv-cinder-84496 Sep 14 12:19:33.945201 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-4cef67e1-a867-4755-91d8-509c81c44a0d req-6afa679f-d1cf-4510-8cdf-1c805455888a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047831 Sep 14 12:19:33.945798 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 579/1163] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:19:34.575542 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e2553cb0-2357-4aa0-82d9-3a517589295f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e801dd7-e56f-4034-93d5-d06db3a0d53f"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:19:34.579655 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e2553cb0-2357-4aa0-82d9-3a517589295f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:34.587563 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2553cb0-2357-4aa0-82d9-3a517589295f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:34.588565 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2553cb0-2357-4aa0-82d9-3a517589295f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:34.589194 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2553cb0-2357-4aa0-82d9-3a517589295f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:34.589979 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2553cb0-2357-4aa0-82d9-3a517589295f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:34.590806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2553cb0-2357-4aa0-82d9-3a517589295f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:34.591433 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e2553cb0-2357-4aa0-82d9-3a517589295f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:35.476773 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e2553cb0-2357-4aa0-82d9-3a517589295f tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "POST /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.905744 Sep 14 12:19:35.477491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 585/1164] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:19:34 2022] POST /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:19:44.332079 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=26 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:44.332945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=56 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:44.337489 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e52bad5f-dd13-4837-9b82-8cda71f84989 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:44.338009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e52bad5f-dd13-4837-9b82-8cda71f84989 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:44.344670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e52bad5f-dd13-4837-9b82-8cda71f84989 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:44.345205 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e52bad5f-dd13-4837-9b82-8cda71f84989 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:44.345636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e52bad5f-dd13-4837-9b82-8cda71f84989 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:44.346526 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e52bad5f-dd13-4837-9b82-8cda71f84989 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:44.346974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e52bad5f-dd13-4837-9b82-8cda71f84989 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:44.347395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e52bad5f-dd13-4837-9b82-8cda71f84989 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:44.432247 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-e52bad5f-dd13-4837-9b82-8cda71f84989 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lazy-loading 'services' on Instance uuid c1fea63d-cc7a-42e9-bde3-86947d2e0999 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:19:44.642950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e52bad5f-dd13-4837-9b82-8cda71f84989 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-volume_attachments/8e801dd7-e56f-4034-93d5-d06db3a0d53f" status: 202 len: 0 microversion: 2.1 time: 0.312633 Sep 14 12:19:44.643583 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 580/1165] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:19:44 2022] DELETE /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-volume_attachments/8e801dd7-e56f-4034-93d5-d06db3a0d53f => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:19:44.652862 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4b8f650f-9382-4d2d-981a-e514e92d2eaa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:44.655874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4b8f650f-9382-4d2d-981a-e514e92d2eaa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:44.658883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=4 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:44.660161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:44.666775 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b8f650f-9382-4d2d-981a-e514e92d2eaa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:44.667617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b8f650f-9382-4d2d-981a-e514e92d2eaa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:44.668139 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b8f650f-9382-4d2d-981a-e514e92d2eaa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:44.669029 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b8f650f-9382-4d2d-981a-e514e92d2eaa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:44.669539 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b8f650f-9382-4d2d-981a-e514e92d2eaa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:44.669990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b8f650f-9382-4d2d-981a-e514e92d2eaa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:44.674113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:44.702352 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4b8f650f-9382-4d2d-981a-e514e92d2eaa tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053859 Sep 14 12:19:44.706025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 586/1166] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:19:44 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:19:45.717070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c9ceb16c-d708-4e60-9c37-e306d04ffb65 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:45.719474 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c9ceb16c-d708-4e60-9c37-e306d04ffb65 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:45.726115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9ceb16c-d708-4e60-9c37-e306d04ffb65 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:45.726727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9ceb16c-d708-4e60-9c37-e306d04ffb65 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:45.727171 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9ceb16c-d708-4e60-9c37-e306d04ffb65 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:45.727893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9ceb16c-d708-4e60-9c37-e306d04ffb65 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:45.728349 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9ceb16c-d708-4e60-9c37-e306d04ffb65 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:45.728780 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c9ceb16c-d708-4e60-9c37-e306d04ffb65 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:45.760869 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c9ceb16c-d708-4e60-9c37-e306d04ffb65 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049131 Sep 14 12:19:45.761514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 581/1167] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:19:45 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:19:46.775092 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a39014b7-43d1-4fa1-9ddb-6b8f0f811c70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:46.777190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a39014b7-43d1-4fa1-9ddb-6b8f0f811c70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:46.785414 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a39014b7-43d1-4fa1-9ddb-6b8f0f811c70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:46.785938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a39014b7-43d1-4fa1-9ddb-6b8f0f811c70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:46.786325 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a39014b7-43d1-4fa1-9ddb-6b8f0f811c70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:46.787023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a39014b7-43d1-4fa1-9ddb-6b8f0f811c70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:46.787473 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a39014b7-43d1-4fa1-9ddb-6b8f0f811c70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:46.787896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a39014b7-43d1-4fa1-9ddb-6b8f0f811c70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:46.818567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a39014b7-43d1-4fa1-9ddb-6b8f0f811c70 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048144 Sep 14 12:19:46.819422 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 587/1168] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:19:46 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 12:19:46.901977 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-006f5053-5f5f-41a4-a2b9-e30398063411 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:46.902760 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-006f5053-5f5f-41a4-a2b9-e30398063411 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:46.911230 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-006f5053-5f5f-41a4-a2b9-e30398063411 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:46.916101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-006f5053-5f5f-41a4-a2b9-e30398063411 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:46.916101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-006f5053-5f5f-41a4-a2b9-e30398063411 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:46.916101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-006f5053-5f5f-41a4-a2b9-e30398063411 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:46.916101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-006f5053-5f5f-41a4-a2b9-e30398063411 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:46.916498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-006f5053-5f5f-41a4-a2b9-e30398063411 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:46.942156 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-006f5053-5f5f-41a4-a2b9-e30398063411 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:19:47.191831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-006f5053-5f5f-41a4-a2b9-e30398063411 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 204 len: 0 microversion: 2.1 time: 0.293519 Sep 14 12:19:47.192471 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 582/1169] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:19:46 2022] DELETE /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:19:47.201746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e9cbbdfa-3290-497d-ab54-ad2c0c009335 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:47.202410 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e9cbbdfa-3290-497d-ab54-ad2c0c009335 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:47.209184 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9cbbdfa-3290-497d-ab54-ad2c0c009335 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:47.209672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9cbbdfa-3290-497d-ab54-ad2c0c009335 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:47.210127 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9cbbdfa-3290-497d-ab54-ad2c0c009335 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:47.210821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9cbbdfa-3290-497d-ab54-ad2c0c009335 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:47.211303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9cbbdfa-3290-497d-ab54-ad2c0c009335 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:47.211721 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e9cbbdfa-3290-497d-ab54-ad2c0c009335 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:47.364271 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e9cbbdfa-3290-497d-ab54-ad2c0c009335 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:47.373648 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e9cbbdfa-3290-497d-ab54-ad2c0c009335 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1683 microversion: 2.1 time: 0.176680 Sep 14 12:19:47.374270 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 588/1170] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:47 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:48.400815 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a3418211-e3a8-41a9-a02c-fa2337f9ae56 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:48.401476 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a3418211-e3a8-41a9-a02c-fa2337f9ae56 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:48.408679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3418211-e3a8-41a9-a02c-fa2337f9ae56 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:48.409167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3418211-e3a8-41a9-a02c-fa2337f9ae56 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:48.409604 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3418211-e3a8-41a9-a02c-fa2337f9ae56 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:48.410336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3418211-e3a8-41a9-a02c-fa2337f9ae56 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:48.410786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3418211-e3a8-41a9-a02c-fa2337f9ae56 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:48.411213 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a3418211-e3a8-41a9-a02c-fa2337f9ae56 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:48.550400 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a3418211-e3a8-41a9-a02c-fa2337f9ae56 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:48.567263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a3418211-e3a8-41a9-a02c-fa2337f9ae56 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1683 microversion: 2.1 time: 0.170890 Sep 14 12:19:48.568344 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 583/1171] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:48 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:19:49.590858 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d417a2b4-1dbe-4763-874e-fb7601c33cb3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:49.591963 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d417a2b4-1dbe-4763-874e-fb7601c33cb3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:49.598900 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d417a2b4-1dbe-4763-874e-fb7601c33cb3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:49.599435 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d417a2b4-1dbe-4763-874e-fb7601c33cb3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:49.599536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d417a2b4-1dbe-4763-874e-fb7601c33cb3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:49.600300 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d417a2b4-1dbe-4763-874e-fb7601c33cb3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:49.600752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d417a2b4-1dbe-4763-874e-fb7601c33cb3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:49.601170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d417a2b4-1dbe-4763-874e-fb7601c33cb3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:49.816589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d417a2b4-1dbe-4763-874e-fb7601c33cb3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:49.825079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d417a2b4-1dbe-4763-874e-fb7601c33cb3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1683 microversion: 2.1 time: 0.238206 Sep 14 12:19:49.826372 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 589/1172] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:49 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1683 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:50.585718 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-f74afe7c-14a6-402a-9557-8f940b100983 req-4a0b722e-67a5-4c8a-9a1c-1535d5c4a4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fea63d-cc7a-42e9-bde3-86947d2e0999", "name": "network-vif-deleted", "tag": "cffd5a86-a259-44e3-9a06-15412c4a2457"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:19:50.600123 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-f74afe7c-14a6-402a-9557-8f940b100983 req-4a0b722e-67a5-4c8a-9a1c-1535d5c4a4a9 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:50.600634 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-f74afe7c-14a6-402a-9557-8f940b100983 req-4a0b722e-67a5-4c8a-9a1c-1535d5c4a4a9 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:50.602677 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-f74afe7c-14a6-402a-9557-8f940b100983 req-4a0b722e-67a5-4c8a-9a1c-1535d5c4a4a9 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:50.615515 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-f74afe7c-14a6-402a-9557-8f940b100983 req-4a0b722e-67a5-4c8a-9a1c-1535d5c4a4a9 service nova] Creating event network-vif-deleted:cffd5a86-a259-44e3-9a06-15412c4a2457 for instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 on hv-cinder-84496 Sep 14 12:19:50.621053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-f74afe7c-14a6-402a-9557-8f940b100983 req-4a0b722e-67a5-4c8a-9a1c-1535d5c4a4a9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039021 Sep 14 12:19:50.622166 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 584/1173] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:19:50.855383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5c353c0b-13ea-459f-a936-252f0918cb75 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:50.855383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5c353c0b-13ea-459f-a936-252f0918cb75 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:50.860469 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c353c0b-13ea-459f-a936-252f0918cb75 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:50.860952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c353c0b-13ea-459f-a936-252f0918cb75 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:50.861380 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c353c0b-13ea-459f-a936-252f0918cb75 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:50.862110 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c353c0b-13ea-459f-a936-252f0918cb75 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:50.862551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c353c0b-13ea-459f-a936-252f0918cb75 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:50.862995 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c353c0b-13ea-459f-a936-252f0918cb75 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:50.937637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5c353c0b-13ea-459f-a936-252f0918cb75 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:50.945833 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5c353c0b-13ea-459f-a936-252f0918cb75 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1327 microversion: 2.1 time: 0.098211 Sep 14 12:19:50.947091 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 590/1174] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:50 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:51.975303 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:51.976020 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:51.983400 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:51.983902 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:51.984347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:51.985244 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:51.985707 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:51.986172 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:52.023339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:52.023836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:52.024276 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:52.024735 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lazy-loading 'fault' on Instance uuid c1fea63d-cc7a-42e9-bde3-86947d2e0999 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:19:52.066496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f3271adc36406fb303fb169020e740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b86ec91335c49aaa672aa85461d2936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:19:52.079056 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-09cf09ed-d88c-4773-a23b-cefb4abb98b3 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 200 len: 1332 microversion: 2.1 time: 0.111228 Sep 14 12:19:52.084033 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 585/1175] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:51 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:19:53.102655 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:53.103571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:53.110233 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:53.110720 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:53.111154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:53.111848 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:53.112292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:53.112721 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:53.126419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 HTTP/1.1 Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:19:53.128060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:53.130036 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'c1fea63d-cc7a-42e9-bde3-86947d2e0999'} Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:19:53.131346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:53.134309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:53.136062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:19:53.136062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-019d08e4-38ce-43c4-b0c0-9ce62c9539b7 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 404 len: 111 microversion: 2.1 time: 0.030923 Sep 14 12:19:53.136062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 591/1176] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:53 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:19:53.138989 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-965262c8-6c8d-46a6-94a9-a35bf9b0193a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '.version_select at 0x7f1c99d378b0>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:53.203741 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-965262c8-6c8d-46a6-94a9-a35bf9b0193a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035052059" status: 202 len: 0 microversion: 2.1 time: 0.069073 Sep 14 12:19:53.204331 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 586/1177] 10.222.0.62 () {58 vars in 1221 bytes} [Wed Sep 14 12:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035052059 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:19:55.244206 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:55.245017 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:55.252505 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:55.252998 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:55.253414 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:55.254138 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:55.254589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:55.255011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:55.268457 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 HTTP/1.1 Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:19:55.270027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:55.271958 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'c1fea63d-cc7a-42e9-bde3-86947d2e0999'} Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:19:55.272934 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:55.274274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:55.275850 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:19:55.275850 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-74273184-b417-4e38-8209-33e027c2234b tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 404 len: 111 microversion: 2.1 time: 0.032840 Sep 14 12:19:55.275850 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 592/1178] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:19:55 2022] DELETE /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:19:55.282071 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:55.282679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c1fea63d-cc7a-42e9-bde3-86947d2e0999] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:55.289284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:55.289772 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:55.290242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:55.290242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:55.291509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:55.291935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:55.306016 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 HTTP/1.1 Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:19:55.307678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:55.309429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': 'c1fea63d-cc7a-42e9-bde3-86947d2e0999'} Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:19:55.310385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. Sep 14 12:19:55.311910 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:55.313330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance c1fea63d-cc7a-42e9-bde3-86947d2e0999 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:19:55.313330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e6142aab-113f-4c46-9636-ff50bcab417d tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999" status: 404 len: 111 microversion: 2.1 time: 0.032580 Sep 14 12:19:55.313330 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 587/1179] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:55 2022] GET /compute/v2.1/servers/c1fea63d-cc7a-42e9-bde3-86947d2e0999 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:19:56.553372 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:56.554051 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:56.560937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:56.561618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:56.562654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:56.563577 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:56.564124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:56.564596 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:56.582046 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df HTTP/1.1 Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:19:56.583623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:19:56.585374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'a6bf2654-f27a-4ec4-9dba-d70e557034df'} Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:19:56.587949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:19:56.589498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.591866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:19:56.591866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9797ebe0-7470-4314-b3c2-68972cf9c097 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 404 len: 111 microversion: 2.1 time: 0.035515 Sep 14 12:19:56.591866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 593/1180] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:19:56 2022] DELETE /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:19:56.594600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:56.595994 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: a6bf2654-f27a-4ec4-9dba-d70e557034df] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:56.602390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:56.603182 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:56.603535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:56.604763 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:56.604763 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:56.604975 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:56.627093 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df HTTP/1.1 Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:19:56.630638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:19:56.632345 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': 'a6bf2654-f27a-4ec4-9dba-d70e557034df'} Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:19:56.633368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. Sep 14 12:19:56.634991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.636688 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance a6bf2654-f27a-4ec4-9dba-d70e557034df could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:19:56.636688 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0fa32208-22c3-4fef-bfa6-93866787b22e tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df" status: 404 len: 111 microversion: 2.1 time: 0.041230 Sep 14 12:19:56.636688 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 588/1181] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:56 2022] GET /compute/v2.1/servers/a6bf2654-f27a-4ec4-9dba-d70e557034df => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:19:56.640674 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:56.641171 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:56.650454 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:56.650943 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:56.651383 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:56.652081 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:56.652530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:56.652951 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:56.668372 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 HTTP/1.1 Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:19:56.670020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:19:56.672885 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '16fe551f-effb-4a0a-b0c2-b4bc82178953'} Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:19:56.674193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:19:56.676633 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.679362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:19:56.679362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d3dc9724-69a2-47da-a812-d139b624e6b5 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 404 len: 111 microversion: 2.1 time: 0.035055 Sep 14 12:19:56.679362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 594/1182] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:19:56 2022] DELETE /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:19:56.682368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:56.683225 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: 16fe551f-effb-4a0a-b0c2-b4bc82178953] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:56.689831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:56.690341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:56.690778 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:56.691602 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:56.692054 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:56.692485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:56.706222 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 HTTP/1.1 Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:19:56.707784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:19:56.709621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '16fe551f-effb-4a0a-b0c2-b4bc82178953'} Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:19:56.710475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. Sep 14 12:19:56.711875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:56.713490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance 16fe551f-effb-4a0a-b0c2-b4bc82178953 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:19:56.713490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a8ed1db5-28b9-4ef2-af88-510aca52027a tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953" status: 404 len: 111 microversion: 2.1 time: 0.032240 Sep 14 12:19:56.713490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 589/1183] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:56 2022] GET /compute/v2.1/servers/16fe551f-effb-4a0a-b0c2-b4bc82178953 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:19:58.075021 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:58.075618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:58.083042 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:58.083537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:58.083972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:58.085267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:58.085267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:58.085551 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:58.100490 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 HTTP/1.1 Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:19:58.102152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:19:58.103842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': 'c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8'} Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:19:58.107717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:19:58.109497 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:19:58.111235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:19:58.111235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-257bb355-52d7-4a13-a8f3-54d88f42eabc tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 404 len: 111 microversion: 2.1 time: 0.032307 Sep 14 12:19:58.111235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 595/1184] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:19:58 2022] DELETE /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:19:58.113078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:19:58.113775 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] [instance: c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:19:58.120749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:58.121446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:58.122261 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:58.123428 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:19:58.124134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:19:58.124821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:19:58.144425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] HTTP exception thrown: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Request method failure captured: Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 HTTP/1.1 Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcQsena8NU2hRt4k9dSVKKPgUjFUYEPFPy27wNYPHbUlEkCxM7Lo-lkobU7WTYpkfTwNJaTz1zt5sFajisNCqoPZ9yn5jqjoOQNzJQu7f3htTYMyu-M9BCyPEEXVN0J8wA85guMeu7zGvfRDr5W6vlxfVH4FiL_mjGUzkixqQ4akw7c Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:19:58.146240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5b86ec91335c49aaa672aa85461d2936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5b86ec91335c49aaa672aa85461d2936"}]}] Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 5b86ec91335c49aaa672aa85461d2936 Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-336415529 Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 31f3271adc36406fb303fb169020e740 Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-AttachVolumeNegativeTest-336415529-project Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:19:58.147877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': 'c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8'} Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:19:58.148768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. Sep 14 12:19:58.150108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:19:58.151336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] Returning 404 to user: Instance c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:19:58.151336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-cfa51cb0-bdfa-4663-8922-6fc1f7919450 tempest-AttachVolumeNegativeTest-336415529 tempest-AttachVolumeNegativeTest-336415529-project] 10.222.0.62 "GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8" status: 404 len: 111 microversion: 2.1 time: 0.039057 Sep 14 12:19:58.151336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 590/1185] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:19:58 2022] GET /compute/v2.1/servers/c978d309-3a1e-4b99-9bfb-7cb8d98dc5d8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 12:20:03.630621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-222016607", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1225028685", "security_groups": [{"name": "tempest-secgroup-smoke-1914131548"}], "block_device_mapping_v2": [{"uuid": "a3ef7089-16ca-4f51-9a31-45bd6e55e11f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7695930d-2da6-4ee9-8437-3753ca9f2e40"}]}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:20:03.746938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.network.neutron [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] validate_networks() for [('7695930d-2da6-4ee9-8437-3753ca9f2e40', None, None, None, None, None)] {{(pid=121152) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:20:04.154482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Flavor limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:20:04.154946 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Image limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:20:04.155457 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Flavor pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:20:04.155862 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Image pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:20:04.156272 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:20:04.165186 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:04.165667 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:04.166142 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:04.166861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:04.167313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:04.167734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:04.185183 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Getting quotas for project e0cdab1c080d4132adc6cd64d8627c68. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:20:04.190066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Getting quotas for user 33f480ef1b8b49df83276a66f445ae85 and project e0cdab1c080d4132adc6cd64d8627c68. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:20:04.257292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Going to run 1 instances... {{(pid=121152) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:20:04.259611 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3ef7089-16ca-4f51-9a31-45bd6e55e11f',volume_size=None,volume_type=None)] {{(pid=121152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:20:04.637587 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-810b945c-31e4-45a5-a9e9-c74fc4affb78 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.010791 Sep 14 12:20:04.638321 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 596/1186] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:20:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:20:04.650942 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-e4fa87d3-d0a4-428f-a76a-92c5c15af66f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:04.651570 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-e4fa87d3-d0a4-428f-a76a-92c5c15af66f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:04.706536 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-e4fa87d3-d0a4-428f-a76a-92c5c15af66f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:04.713511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-e4fa87d3-d0a4-428f-a76a-92c5c15af66f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1094 microversion: 2.1 time: 0.066500 Sep 14 12:20:04.714110 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 591/1187] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:04 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:05.736438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-06b90fbc-019a-44f6-98ff-73ebd08d413d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:05.737049 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-06b90fbc-019a-44f6-98ff-73ebd08d413d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:05.743146 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b90fbc-019a-44f6-98ff-73ebd08d413d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:05.743645 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b90fbc-019a-44f6-98ff-73ebd08d413d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:05.744086 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b90fbc-019a-44f6-98ff-73ebd08d413d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:05.744798 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b90fbc-019a-44f6-98ff-73ebd08d413d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:05.745249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b90fbc-019a-44f6-98ff-73ebd08d413d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:05.745676 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06b90fbc-019a-44f6-98ff-73ebd08d413d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:05.813997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-06b90fbc-019a-44f6-98ff-73ebd08d413d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:05.823154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-06b90fbc-019a-44f6-98ff-73ebd08d413d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1144 microversion: 2.1 time: 0.091404 Sep 14 12:20:05.823944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 597/1188] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:05 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:06.847964 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0ef402f7-6aa1-4fd4-bb28-d11e8897f0c0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:06.849153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0ef402f7-6aa1-4fd4-bb28-d11e8897f0c0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:06.858281 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ef402f7-6aa1-4fd4-bb28-d11e8897f0c0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:06.859449 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ef402f7-6aa1-4fd4-bb28-d11e8897f0c0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:06.859938 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ef402f7-6aa1-4fd4-bb28-d11e8897f0c0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:06.860657 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ef402f7-6aa1-4fd4-bb28-d11e8897f0c0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:06.861114 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ef402f7-6aa1-4fd4-bb28-d11e8897f0c0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:06.861537 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0ef402f7-6aa1-4fd4-bb28-d11e8897f0c0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:06.928937 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0ef402f7-6aa1-4fd4-bb28-d11e8897f0c0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:06.937073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0ef402f7-6aa1-4fd4-bb28-d11e8897f0c0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1192 microversion: 2.1 time: 0.093721 Sep 14 12:20:06.937658 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 592/1189] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:06 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:20:07.961732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9e0f76fb-b137-40d2-a752-60775b069dcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:07.963557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9e0f76fb-b137-40d2-a752-60775b069dcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:07.969276 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e0f76fb-b137-40d2-a752-60775b069dcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:07.969762 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e0f76fb-b137-40d2-a752-60775b069dcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:07.970230 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e0f76fb-b137-40d2-a752-60775b069dcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:07.971043 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e0f76fb-b137-40d2-a752-60775b069dcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:07.971393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e0f76fb-b137-40d2-a752-60775b069dcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:07.972482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9e0f76fb-b137-40d2-a752-60775b069dcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:08.135844 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9e0f76fb-b137-40d2-a752-60775b069dcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:08.144689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9e0f76fb-b137-40d2-a752-60775b069dcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1278 microversion: 2.1 time: 0.187738 Sep 14 12:20:08.146535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 598/1190] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:07 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:09.174721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5c6be6f2-7fc1-436c-b1a4-53e244540ddb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:09.175327 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5c6be6f2-7fc1-436c-b1a4-53e244540ddb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:09.181674 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5c6be6f2-7fc1-436c-b1a4-53e244540ddb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:09.182211 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5c6be6f2-7fc1-436c-b1a4-53e244540ddb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:09.182647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5c6be6f2-7fc1-436c-b1a4-53e244540ddb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:09.183342 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5c6be6f2-7fc1-436c-b1a4-53e244540ddb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:09.183791 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5c6be6f2-7fc1-436c-b1a4-53e244540ddb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:09.184211 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5c6be6f2-7fc1-436c-b1a4-53e244540ddb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:09.313650 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5c6be6f2-7fc1-436c-b1a4-53e244540ddb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:09.322203 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5c6be6f2-7fc1-436c-b1a4-53e244540ddb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1278 microversion: 2.1 time: 0.151720 Sep 14 12:20:09.322980 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 593/1191] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:09 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:10.346504 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-182cd765-2bab-40c1-abc6-3ad507296d32 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:10.347124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-182cd765-2bab-40c1-abc6-3ad507296d32 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:10.353701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-182cd765-2bab-40c1-abc6-3ad507296d32 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:10.354257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-182cd765-2bab-40c1-abc6-3ad507296d32 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:10.354703 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-182cd765-2bab-40c1-abc6-3ad507296d32 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:10.355401 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-182cd765-2bab-40c1-abc6-3ad507296d32 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:10.355862 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-182cd765-2bab-40c1-abc6-3ad507296d32 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:10.356291 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-182cd765-2bab-40c1-abc6-3ad507296d32 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:10.488172 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-182cd765-2bab-40c1-abc6-3ad507296d32 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:10.496013 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-182cd765-2bab-40c1-abc6-3ad507296d32 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1278 microversion: 2.1 time: 0.154677 Sep 14 12:20:10.496587 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 599/1192] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:10 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:11.518814 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4d9e66de-7718-4a0c-b440-62bb01b455fd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:11.519437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4d9e66de-7718-4a0c-b440-62bb01b455fd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:11.526661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d9e66de-7718-4a0c-b440-62bb01b455fd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:11.527178 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d9e66de-7718-4a0c-b440-62bb01b455fd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:11.527614 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d9e66de-7718-4a0c-b440-62bb01b455fd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:11.528305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d9e66de-7718-4a0c-b440-62bb01b455fd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:11.528751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d9e66de-7718-4a0c-b440-62bb01b455fd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:11.529175 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4d9e66de-7718-4a0c-b440-62bb01b455fd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:11.853486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4d9e66de-7718-4a0c-b440-62bb01b455fd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:11.861992 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4d9e66de-7718-4a0c-b440-62bb01b455fd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1278 microversion: 2.1 time: 0.346980 Sep 14 12:20:11.862652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 594/1193] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:11 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1278 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:12.755646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-a747a850-ef65-408c-9466-ed63cd40eb1e req-6d62b4bd-c69c-4014-b359-4f4d3bd12094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e2d5b4-de88-42a8-8e7c-d6dd04c49794", "tag": "3e4b4210-37df-4a36-8bce-d12d7d842ae2"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:20:12.766802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-a747a850-ef65-408c-9466-ed63cd40eb1e req-6d62b4bd-c69c-4014-b359-4f4d3bd12094 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:12.768180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-a747a850-ef65-408c-9466-ed63cd40eb1e req-6d62b4bd-c69c-4014-b359-4f4d3bd12094 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:12.768180 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-a747a850-ef65-408c-9466-ed63cd40eb1e req-6d62b4bd-c69c-4014-b359-4f4d3bd12094 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:12.779066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-a747a850-ef65-408c-9466-ed63cd40eb1e req-6d62b4bd-c69c-4014-b359-4f4d3bd12094 service nova] Creating event network-changed:3e4b4210-37df-4a36-8bce-d12d7d842ae2 for instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 on hv-cinder-84496 Sep 14 12:20:12.784826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-a747a850-ef65-408c-9466-ed63cd40eb1e req-6d62b4bd-c69c-4014-b359-4f4d3bd12094 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032923 Sep 14 12:20:12.785432 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 600/1194] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:20:12.885006 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-78642097-7af1-422a-bf5a-a7e55ed26a10 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:12.885662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-78642097-7af1-422a-bf5a-a7e55ed26a10 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:12.892698 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78642097-7af1-422a-bf5a-a7e55ed26a10 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:12.893190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78642097-7af1-422a-bf5a-a7e55ed26a10 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:12.893653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78642097-7af1-422a-bf5a-a7e55ed26a10 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:12.894386 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78642097-7af1-422a-bf5a-a7e55ed26a10 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:12.894880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78642097-7af1-422a-bf5a-a7e55ed26a10 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:12.895311 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78642097-7af1-422a-bf5a-a7e55ed26a10 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:13.132540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-78642097-7af1-422a-bf5a-a7e55ed26a10 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:13.140333 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-78642097-7af1-422a-bf5a-a7e55ed26a10 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1278 microversion: 2.1 time: 0.259547 Sep 14 12:20:13.140905 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 595/1195] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:12 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:14.163926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-584b1b84-48b5-4a31-84c6-3f13defe88c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:14.164751 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-584b1b84-48b5-4a31-84c6-3f13defe88c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:14.171808 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-584b1b84-48b5-4a31-84c6-3f13defe88c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:14.172301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-584b1b84-48b5-4a31-84c6-3f13defe88c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:14.172736 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-584b1b84-48b5-4a31-84c6-3f13defe88c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:14.173422 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-584b1b84-48b5-4a31-84c6-3f13defe88c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:14.173896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-584b1b84-48b5-4a31-84c6-3f13defe88c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:14.174352 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-584b1b84-48b5-4a31-84c6-3f13defe88c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:14.178330 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:14.197367 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=6 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:14.311897 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-584b1b84-48b5-4a31-84c6-3f13defe88c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:14.319521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-584b1b84-48b5-4a31-84c6-3f13defe88c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.160385 Sep 14 12:20:14.320095 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 601/1196] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:14 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:15.341916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-69a3bb90-b5f6-48b3-9623-e23511331f89 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:15.342522 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-69a3bb90-b5f6-48b3-9623-e23511331f89 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:15.344892 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:15.345555 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:15.350194 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69a3bb90-b5f6-48b3-9623-e23511331f89 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:15.350670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69a3bb90-b5f6-48b3-9623-e23511331f89 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:15.351107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69a3bb90-b5f6-48b3-9623-e23511331f89 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:15.351784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69a3bb90-b5f6-48b3-9623-e23511331f89 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:15.352229 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69a3bb90-b5f6-48b3-9623-e23511331f89 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:15.352648 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-69a3bb90-b5f6-48b3-9623-e23511331f89 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:15.356460 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:15.486966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-69a3bb90-b5f6-48b3-9623-e23511331f89 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:15.494511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-69a3bb90-b5f6-48b3-9623-e23511331f89 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.156466 Sep 14 12:20:15.495071 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 596/1197] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:15 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:16.518224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-cef8ebce-bb8a-4c01-8c29-7c83fab96ea6 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:16.518850 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-cef8ebce-bb8a-4c01-8c29-7c83fab96ea6 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:16.525873 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cef8ebce-bb8a-4c01-8c29-7c83fab96ea6 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:16.526371 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cef8ebce-bb8a-4c01-8c29-7c83fab96ea6 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:16.526808 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cef8ebce-bb8a-4c01-8c29-7c83fab96ea6 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:16.527502 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cef8ebce-bb8a-4c01-8c29-7c83fab96ea6 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:16.527954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cef8ebce-bb8a-4c01-8c29-7c83fab96ea6 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:16.528373 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-cef8ebce-bb8a-4c01-8c29-7c83fab96ea6 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:16.667395 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-cef8ebce-bb8a-4c01-8c29-7c83fab96ea6 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:16.675555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-cef8ebce-bb8a-4c01-8c29-7c83fab96ea6 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.161197 Sep 14 12:20:16.676128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 602/1198] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:16 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:17.698384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4da97911-8005-4cf6-9237-ec4775059d0b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:17.699016 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4da97911-8005-4cf6-9237-ec4775059d0b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:17.706221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4da97911-8005-4cf6-9237-ec4775059d0b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:17.706708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4da97911-8005-4cf6-9237-ec4775059d0b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:17.707139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4da97911-8005-4cf6-9237-ec4775059d0b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:17.707821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4da97911-8005-4cf6-9237-ec4775059d0b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:17.708269 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4da97911-8005-4cf6-9237-ec4775059d0b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:17.708906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4da97911-8005-4cf6-9237-ec4775059d0b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:17.845296 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4da97911-8005-4cf6-9237-ec4775059d0b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:17.853475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4da97911-8005-4cf6-9237-ec4775059d0b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.159468 Sep 14 12:20:17.854070 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 597/1199] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:17 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:18.876855 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f91e8357-8e50-4975-b43b-1cb0ae43c098 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:18.877609 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f91e8357-8e50-4975-b43b-1cb0ae43c098 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:18.879988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:18.884705 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f91e8357-8e50-4975-b43b-1cb0ae43c098 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:18.885189 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f91e8357-8e50-4975-b43b-1cb0ae43c098 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:18.885635 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f91e8357-8e50-4975-b43b-1cb0ae43c098 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:18.886385 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f91e8357-8e50-4975-b43b-1cb0ae43c098 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:18.886836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f91e8357-8e50-4975-b43b-1cb0ae43c098 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:18.887261 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f91e8357-8e50-4975-b43b-1cb0ae43c098 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:18.891211 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=74 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:19.022752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f91e8357-8e50-4975-b43b-1cb0ae43c098 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:19.030504 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f91e8357-8e50-4975-b43b-1cb0ae43c098 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.158083 Sep 14 12:20:19.031071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 603/1200] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:18 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:20.053297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9b8acf5c-1776-496d-a343-3fdf70554fde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:20.053935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9b8acf5c-1776-496d-a343-3fdf70554fde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:20.060631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8acf5c-1776-496d-a343-3fdf70554fde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:20.061121 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8acf5c-1776-496d-a343-3fdf70554fde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:20.061638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8acf5c-1776-496d-a343-3fdf70554fde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:20.080678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8acf5c-1776-496d-a343-3fdf70554fde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:20.080678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8acf5c-1776-496d-a343-3fdf70554fde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:20.080678 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9b8acf5c-1776-496d-a343-3fdf70554fde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:20.196905 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-9b8acf5c-1776-496d-a343-3fdf70554fde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:20.204676 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9b8acf5c-1776-496d-a343-3fdf70554fde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.155292 Sep 14 12:20:20.205485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 598/1201] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:20 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:21.228025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f850c11d-7e1f-40b5-80de-16bedd0ef3fe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:21.228649 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f850c11d-7e1f-40b5-80de-16bedd0ef3fe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:21.236714 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f850c11d-7e1f-40b5-80de-16bedd0ef3fe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:21.237200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f850c11d-7e1f-40b5-80de-16bedd0ef3fe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:21.237641 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f850c11d-7e1f-40b5-80de-16bedd0ef3fe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:21.238389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f850c11d-7e1f-40b5-80de-16bedd0ef3fe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:21.238931 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f850c11d-7e1f-40b5-80de-16bedd0ef3fe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:21.239467 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f850c11d-7e1f-40b5-80de-16bedd0ef3fe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:21.378394 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f850c11d-7e1f-40b5-80de-16bedd0ef3fe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:21.386213 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f850c11d-7e1f-40b5-80de-16bedd0ef3fe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.162105 Sep 14 12:20:21.386846 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 604/1202] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:21 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:20:22.410078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0c378513-cb25-42ab-be22-d40489073d25 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:22.410629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0c378513-cb25-42ab-be22-d40489073d25 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:22.416597 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c378513-cb25-42ab-be22-d40489073d25 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:22.417086 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c378513-cb25-42ab-be22-d40489073d25 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:22.417524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c378513-cb25-42ab-be22-d40489073d25 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:22.418248 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c378513-cb25-42ab-be22-d40489073d25 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:22.418706 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c378513-cb25-42ab-be22-d40489073d25 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:22.419137 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0c378513-cb25-42ab-be22-d40489073d25 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:22.551305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0c378513-cb25-42ab-be22-d40489073d25 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:22.558865 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0c378513-cb25-42ab-be22-d40489073d25 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.153470 Sep 14 12:20:22.559429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 599/1203] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:22 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:23.581716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7c0f222f-7a88-4cdd-8ed9-662e7e4c580c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:23.582358 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7c0f222f-7a88-4cdd-8ed9-662e7e4c580c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:23.588683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c0f222f-7a88-4cdd-8ed9-662e7e4c580c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:23.589167 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c0f222f-7a88-4cdd-8ed9-662e7e4c580c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:23.589599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c0f222f-7a88-4cdd-8ed9-662e7e4c580c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:23.590314 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c0f222f-7a88-4cdd-8ed9-662e7e4c580c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:23.590763 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c0f222f-7a88-4cdd-8ed9-662e7e4c580c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:23.591184 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7c0f222f-7a88-4cdd-8ed9-662e7e4c580c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:23.721876 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7c0f222f-7a88-4cdd-8ed9-662e7e4c580c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:23.729386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7c0f222f-7a88-4cdd-8ed9-662e7e4c580c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.152177 Sep 14 12:20:23.729967 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 605/1204] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:23 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:24.752102 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0323fdb0-0110-488e-9b70-c0bcf8be2497 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:24.752708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0323fdb0-0110-488e-9b70-c0bcf8be2497 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:24.759193 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0323fdb0-0110-488e-9b70-c0bcf8be2497 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:24.759677 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0323fdb0-0110-488e-9b70-c0bcf8be2497 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:24.760119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0323fdb0-0110-488e-9b70-c0bcf8be2497 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:24.760802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0323fdb0-0110-488e-9b70-c0bcf8be2497 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:24.761251 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0323fdb0-0110-488e-9b70-c0bcf8be2497 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:24.761675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0323fdb0-0110-488e-9b70-c0bcf8be2497 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:24.896239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0323fdb0-0110-488e-9b70-c0bcf8be2497 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:24.904002 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0323fdb0-0110-488e-9b70-c0bcf8be2497 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.155799 Sep 14 12:20:24.907684 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 600/1205] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:24 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:25.927346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-79f762d4-78a4-4f18-812f-c13aefd245cb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:25.927967 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-79f762d4-78a4-4f18-812f-c13aefd245cb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:25.934697 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79f762d4-78a4-4f18-812f-c13aefd245cb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:25.935186 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79f762d4-78a4-4f18-812f-c13aefd245cb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:25.935626 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79f762d4-78a4-4f18-812f-c13aefd245cb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:25.936315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79f762d4-78a4-4f18-812f-c13aefd245cb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:25.937385 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79f762d4-78a4-4f18-812f-c13aefd245cb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:25.937811 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-79f762d4-78a4-4f18-812f-c13aefd245cb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:26.065350 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-79f762d4-78a4-4f18-812f-c13aefd245cb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:26.073163 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-79f762d4-78a4-4f18-812f-c13aefd245cb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.149710 Sep 14 12:20:26.073748 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 606/1206] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:25 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:27.095985 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-769b7ca0-40bb-411d-8d86-e04173511681 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:27.096593 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-769b7ca0-40bb-411d-8d86-e04173511681 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:27.103042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-769b7ca0-40bb-411d-8d86-e04173511681 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:27.103521 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-769b7ca0-40bb-411d-8d86-e04173511681 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:27.103952 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-769b7ca0-40bb-411d-8d86-e04173511681 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:27.104636 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-769b7ca0-40bb-411d-8d86-e04173511681 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:27.105090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-769b7ca0-40bb-411d-8d86-e04173511681 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:27.105509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-769b7ca0-40bb-411d-8d86-e04173511681 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:27.239136 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-769b7ca0-40bb-411d-8d86-e04173511681 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:27.246885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-769b7ca0-40bb-411d-8d86-e04173511681 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.155318 Sep 14 12:20:27.247456 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 601/1207] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:27 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:28.270913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-477c14f9-58f8-41da-ac1e-189bdc191ca9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:28.271524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-477c14f9-58f8-41da-ac1e-189bdc191ca9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:28.277988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-477c14f9-58f8-41da-ac1e-189bdc191ca9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:28.278477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-477c14f9-58f8-41da-ac1e-189bdc191ca9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:28.278911 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-477c14f9-58f8-41da-ac1e-189bdc191ca9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:28.279595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-477c14f9-58f8-41da-ac1e-189bdc191ca9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:28.280538 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-477c14f9-58f8-41da-ac1e-189bdc191ca9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:28.280959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-477c14f9-58f8-41da-ac1e-189bdc191ca9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:28.413158 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-477c14f9-58f8-41da-ac1e-189bdc191ca9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:28.421623 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-477c14f9-58f8-41da-ac1e-189bdc191ca9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.154203 Sep 14 12:20:28.422639 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 607/1208] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:28 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:29.444237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a58e9cb7-2cd5-4faf-be8d-b4a229ddfafc tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:29.444917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a58e9cb7-2cd5-4faf-be8d-b4a229ddfafc tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:29.451827 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a58e9cb7-2cd5-4faf-be8d-b4a229ddfafc tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:29.452817 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a58e9cb7-2cd5-4faf-be8d-b4a229ddfafc tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:29.453255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a58e9cb7-2cd5-4faf-be8d-b4a229ddfafc tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:29.453983 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a58e9cb7-2cd5-4faf-be8d-b4a229ddfafc tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:29.454439 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a58e9cb7-2cd5-4faf-be8d-b4a229ddfafc tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:29.454860 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a58e9cb7-2cd5-4faf-be8d-b4a229ddfafc tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:29.601916 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a58e9cb7-2cd5-4faf-be8d-b4a229ddfafc tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:29.610501 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a58e9cb7-2cd5-4faf-be8d-b4a229ddfafc tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.170146 Sep 14 12:20:29.613385 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 602/1209] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:29 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:30.634184 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-afa82fde-f7d2-4135-849f-59f586d96bfe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:30.634877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-afa82fde-f7d2-4135-849f-59f586d96bfe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:30.641573 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-afa82fde-f7d2-4135-849f-59f586d96bfe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:30.642097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-afa82fde-f7d2-4135-849f-59f586d96bfe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:30.642645 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-afa82fde-f7d2-4135-849f-59f586d96bfe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:30.643345 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-afa82fde-f7d2-4135-849f-59f586d96bfe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:30.643799 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-afa82fde-f7d2-4135-849f-59f586d96bfe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:30.644212 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-afa82fde-f7d2-4135-849f-59f586d96bfe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:30.791974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-afa82fde-f7d2-4135-849f-59f586d96bfe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:30.800999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-afa82fde-f7d2-4135-849f-59f586d96bfe tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.170737 Sep 14 12:20:30.801577 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 608/1210] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:30 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:20:31.825428 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-79cd85d2-32eb-4ebf-8189-f24fe7acdbcd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:31.826525 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-79cd85d2-32eb-4ebf-8189-f24fe7acdbcd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:31.835634 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79cd85d2-32eb-4ebf-8189-f24fe7acdbcd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:31.836130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79cd85d2-32eb-4ebf-8189-f24fe7acdbcd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:31.836582 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79cd85d2-32eb-4ebf-8189-f24fe7acdbcd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:31.837277 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79cd85d2-32eb-4ebf-8189-f24fe7acdbcd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:31.837778 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79cd85d2-32eb-4ebf-8189-f24fe7acdbcd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:31.838293 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-79cd85d2-32eb-4ebf-8189-f24fe7acdbcd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:31.972589 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-79cd85d2-32eb-4ebf-8189-f24fe7acdbcd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:31.980831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-79cd85d2-32eb-4ebf-8189-f24fe7acdbcd tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.161516 Sep 14 12:20:31.981425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 603/1211] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:31 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:33.003765 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7e2fe75f-979e-4827-be28-d687bcfbb380 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:33.004320 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7e2fe75f-979e-4827-be28-d687bcfbb380 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:33.010795 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e2fe75f-979e-4827-be28-d687bcfbb380 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:33.011282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e2fe75f-979e-4827-be28-d687bcfbb380 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:33.011720 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e2fe75f-979e-4827-be28-d687bcfbb380 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:33.012419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e2fe75f-979e-4827-be28-d687bcfbb380 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:33.012875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e2fe75f-979e-4827-be28-d687bcfbb380 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:33.013301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7e2fe75f-979e-4827-be28-d687bcfbb380 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:33.149078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7e2fe75f-979e-4827-be28-d687bcfbb380 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:33.157628 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7e2fe75f-979e-4827-be28-d687bcfbb380 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.157888 Sep 14 12:20:33.160235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 609/1212] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:32 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:33.479955 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-29891bcd-62d2-4752-97f6-37e31c3eb071 req-98f5067e-cdd0-4393-9a4b-ee5323222fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e2d5b4-de88-42a8-8e7c-d6dd04c49794", "name": "network-vif-plugged", "status": "completed", "tag": "3e4b4210-37df-4a36-8bce-d12d7d842ae2"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:20:33.489761 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-29891bcd-62d2-4752-97f6-37e31c3eb071 req-98f5067e-cdd0-4393-9a4b-ee5323222fbe service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:33.490632 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-29891bcd-62d2-4752-97f6-37e31c3eb071 req-98f5067e-cdd0-4393-9a4b-ee5323222fbe service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:33.490774 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-29891bcd-62d2-4752-97f6-37e31c3eb071 req-98f5067e-cdd0-4393-9a4b-ee5323222fbe service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:33.502670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-29891bcd-62d2-4752-97f6-37e31c3eb071 req-98f5067e-cdd0-4393-9a4b-ee5323222fbe service nova] Creating event network-vif-plugged:3e4b4210-37df-4a36-8bce-d12d7d842ae2 for instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 on hv-cinder-84496 Sep 14 12:20:33.507924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-29891bcd-62d2-4752-97f6-37e31c3eb071 req-98f5067e-cdd0-4393-9a4b-ee5323222fbe service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031902 Sep 14 12:20:33.508535 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 604/1213] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:20:34.180303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-376f98cc-d7ce-40f1-bd17-d7e2c4c86f9d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:34.181019 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-376f98cc-d7ce-40f1-bd17-d7e2c4c86f9d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:34.188256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-376f98cc-d7ce-40f1-bd17-d7e2c4c86f9d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:34.188745 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-376f98cc-d7ce-40f1-bd17-d7e2c4c86f9d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:34.189176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-376f98cc-d7ce-40f1-bd17-d7e2c4c86f9d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:34.189878 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-376f98cc-d7ce-40f1-bd17-d7e2c4c86f9d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:34.190335 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-376f98cc-d7ce-40f1-bd17-d7e2c4c86f9d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:34.190752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-376f98cc-d7ce-40f1-bd17-d7e2c4c86f9d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:34.332391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-376f98cc-d7ce-40f1-bd17-d7e2c4c86f9d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:34.340418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-376f98cc-d7ce-40f1-bd17-d7e2c4c86f9d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.163839 Sep 14 12:20:34.340827 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 610/1214] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:34 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:35.363839 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-177c2092-1aa0-4323-a53e-1800fe66f628 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:35.364571 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-177c2092-1aa0-4323-a53e-1800fe66f628 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:35.370751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-177c2092-1aa0-4323-a53e-1800fe66f628 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:35.371236 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-177c2092-1aa0-4323-a53e-1800fe66f628 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:35.371667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-177c2092-1aa0-4323-a53e-1800fe66f628 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:35.372355 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-177c2092-1aa0-4323-a53e-1800fe66f628 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:35.372803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-177c2092-1aa0-4323-a53e-1800fe66f628 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:35.373225 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-177c2092-1aa0-4323-a53e-1800fe66f628 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:35.513105 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-177c2092-1aa0-4323-a53e-1800fe66f628 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:35.521052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-177c2092-1aa0-4323-a53e-1800fe66f628 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1266 microversion: 2.1 time: 0.162096 Sep 14 12:20:35.521621 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 605/1215] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:35 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:20:36.545242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-feaa26ee-3bfa-47d3-a67c-1ac65b21f170 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:36.550669 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-feaa26ee-3bfa-47d3-a67c-1ac65b21f170 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:36.552586 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-feaa26ee-3bfa-47d3-a67c-1ac65b21f170 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:36.553074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-feaa26ee-3bfa-47d3-a67c-1ac65b21f170 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:36.553507 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-feaa26ee-3bfa-47d3-a67c-1ac65b21f170 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:36.554265 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-feaa26ee-3bfa-47d3-a67c-1ac65b21f170 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:36.554715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-feaa26ee-3bfa-47d3-a67c-1ac65b21f170 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:36.555138 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-feaa26ee-3bfa-47d3-a67c-1ac65b21f170 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:36.690476 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-feaa26ee-3bfa-47d3-a67c-1ac65b21f170 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:36.698315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-feaa26ee-3bfa-47d3-a67c-1ac65b21f170 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1454 microversion: 2.1 time: 0.157006 Sep 14 12:20:36.698886 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 611/1216] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:36 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:20:36.720872 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5bdcb68b-335a-486c-94a5-0ef37941f18b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:20:36.721791 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5bdcb68b-335a-486c-94a5-0ef37941f18b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:20:36.728376 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bdcb68b-335a-486c-94a5-0ef37941f18b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:36.728857 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bdcb68b-335a-486c-94a5-0ef37941f18b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:36.729324 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bdcb68b-335a-486c-94a5-0ef37941f18b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:36.730102 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bdcb68b-335a-486c-94a5-0ef37941f18b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:36.730540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bdcb68b-335a-486c-94a5-0ef37941f18b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:36.730971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5bdcb68b-335a-486c-94a5-0ef37941f18b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:36.869053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5bdcb68b-335a-486c-94a5-0ef37941f18b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:20:36.879195 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5bdcb68b-335a-486c-94a5-0ef37941f18b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1454 microversion: 2.1 time: 0.162016 Sep 14 12:20:36.879792 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 606/1217] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:20:36 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:20:39.235780 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-2d54b269-e513-41d7-93d1-9e88338d811f req-ba6df30a-dd84-42e9-9366-1bf43b8186d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e2d5b4-de88-42a8-8e7c-d6dd04c49794", "tag": "3e4b4210-37df-4a36-8bce-d12d7d842ae2"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:20:39.245448 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-2d54b269-e513-41d7-93d1-9e88338d811f req-ba6df30a-dd84-42e9-9366-1bf43b8186d7 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:20:39.246050 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-2d54b269-e513-41d7-93d1-9e88338d811f req-ba6df30a-dd84-42e9-9366-1bf43b8186d7 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:20:39.246484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-2d54b269-e513-41d7-93d1-9e88338d811f req-ba6df30a-dd84-42e9-9366-1bf43b8186d7 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:20:39.258391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-2d54b269-e513-41d7-93d1-9e88338d811f req-ba6df30a-dd84-42e9-9366-1bf43b8186d7 service nova] Creating event network-changed:3e4b4210-37df-4a36-8bce-d12d7d842ae2 for instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 on hv-cinder-84496 Sep 14 12:20:39.263554 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-2d54b269-e513-41d7-93d1-9e88338d811f req-ba6df30a-dd84-42e9-9366-1bf43b8186d7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153750 Sep 14 12:20:39.264396 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 612/1218] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:21:44.798165 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=21 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:44.799071 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=61 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:44.804170 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-677738714", "imageRef": "24a87c51-0739-4001-8972-84076ce4e2a4", "flavorRef": "452"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:21:45.049747 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] validate_networks() for None {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:21:45.335175 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:21:45.335606 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:21:45.336078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:21:45.336487 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:21:45.336922 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:21:45.345515 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:45.346030 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:45.346463 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:45.347179 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:45.348110 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:45.348531 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:45.366863 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Getting quotas for project 33a46571f6a64b65aa0e37f67cfdae0c. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:21:45.370800 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Getting quotas for user 0bbebfb828cb410a818a87a9bb5717cd and project 33a46571f6a64b65aa0e37f67cfdae0c. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:21:45.381704 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:21:45.384165 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24a87c51-0739-4001-8972-84076ce4e2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:21:45.471352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-05f43aee-7cf1-4872-a8be-785b21c52aeb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674944 Sep 14 12:21:45.472025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 607/1219] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:21:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:21:45.484707 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=19 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:45.486012 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=55 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:45.488152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 12:21:45.488821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Wed Sep 14 12:21:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe (ip 10.222.0.62) !!! Sep 14 12:21:45.499810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4787dea3-c135-41fc-acd9-c31818731246 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:45.499810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4787dea3-c135-41fc-acd9-c31818731246 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:45.661006 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4787dea3-c135-41fc-acd9-c31818731246 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:45.668784 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4787dea3-c135-41fc-acd9-c31818731246 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1214 microversion: 2.1 time: 0.188310 Sep 14 12:21:45.669358 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 613/1220] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:45 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:46.693766 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1ba046c0-6691-4743-85e2-3d03509cef4d tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:46.694433 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1ba046c0-6691-4743-85e2-3d03509cef4d tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:46.701227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ba046c0-6691-4743-85e2-3d03509cef4d tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:46.701715 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ba046c0-6691-4743-85e2-3d03509cef4d tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:46.702193 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ba046c0-6691-4743-85e2-3d03509cef4d tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:46.702883 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ba046c0-6691-4743-85e2-3d03509cef4d tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:46.703335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ba046c0-6691-4743-85e2-3d03509cef4d tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:46.703764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ba046c0-6691-4743-85e2-3d03509cef4d tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:46.769302 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1ba046c0-6691-4743-85e2-3d03509cef4d tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:46.778021 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1ba046c0-6691-4743-85e2-3d03509cef4d tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1218 microversion: 2.1 time: 0.089417 Sep 14 12:21:46.782516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 608/1221] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:46 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:47.801160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2abcbdfb-ab5b-42e2-a3e5-e1c020693a1f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:47.801782 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2abcbdfb-ab5b-42e2-a3e5-e1c020693a1f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:47.808666 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2abcbdfb-ab5b-42e2-a3e5-e1c020693a1f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:47.809159 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2abcbdfb-ab5b-42e2-a3e5-e1c020693a1f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:47.809605 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2abcbdfb-ab5b-42e2-a3e5-e1c020693a1f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:47.810394 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2abcbdfb-ab5b-42e2-a3e5-e1c020693a1f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:47.810855 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2abcbdfb-ab5b-42e2-a3e5-e1c020693a1f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:47.811285 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2abcbdfb-ab5b-42e2-a3e5-e1c020693a1f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:47.890937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2abcbdfb-ab5b-42e2-a3e5-e1c020693a1f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:47.901169 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2abcbdfb-ab5b-42e2-a3e5-e1c020693a1f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1274 microversion: 2.1 time: 0.103709 Sep 14 12:21:47.902130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 614/1222] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:47 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:48.924265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-13576024-fd3c-45a7-91c0-0aff7c9bf7be tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:48.926080 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-13576024-fd3c-45a7-91c0-0aff7c9bf7be tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:48.932082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13576024-fd3c-45a7-91c0-0aff7c9bf7be tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:48.932587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13576024-fd3c-45a7-91c0-0aff7c9bf7be tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:48.933034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13576024-fd3c-45a7-91c0-0aff7c9bf7be tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:48.933753 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13576024-fd3c-45a7-91c0-0aff7c9bf7be tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:48.934239 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13576024-fd3c-45a7-91c0-0aff7c9bf7be tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:48.934670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13576024-fd3c-45a7-91c0-0aff7c9bf7be tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:49.156609 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13576024-fd3c-45a7-91c0-0aff7c9bf7be tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:49.164865 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-13576024-fd3c-45a7-91c0-0aff7c9bf7be tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1314 microversion: 2.1 time: 0.244395 Sep 14 12:21:49.165474 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 609/1223] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:48 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:50.093242 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-a7bcbca6-d181-4472-9654-6d11d4cf5dd6 req-27544a8c-972d-4525-8bd7-234e5f2ca798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9211e016-bd66-474d-9b1c-20ce2b43dabe", "tag": "640989ff-0263-4c2e-b610-171e3cd91406"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:21:50.104506 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-a7bcbca6-d181-4472-9654-6d11d4cf5dd6 req-27544a8c-972d-4525-8bd7-234e5f2ca798 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:50.104985 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-a7bcbca6-d181-4472-9654-6d11d4cf5dd6 req-27544a8c-972d-4525-8bd7-234e5f2ca798 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:50.105410 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-a7bcbca6-d181-4472-9654-6d11d4cf5dd6 req-27544a8c-972d-4525-8bd7-234e5f2ca798 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:50.116700 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-a7bcbca6-d181-4472-9654-6d11d4cf5dd6 req-27544a8c-972d-4525-8bd7-234e5f2ca798 service nova] Creating event network-changed:640989ff-0263-4c2e-b610-171e3cd91406 for instance 9211e016-bd66-474d-9b1c-20ce2b43dabe on hv-cinder-84496 Sep 14 12:21:50.122050 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-a7bcbca6-d181-4472-9654-6d11d4cf5dd6 req-27544a8c-972d-4525-8bd7-234e5f2ca798 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032332 Sep 14 12:21:50.122830 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 615/1224] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:21:50.191633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-586264b9-4e67-4881-989a-b86ec84bf887 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:50.192317 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-586264b9-4e67-4881-989a-b86ec84bf887 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:50.199643 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-586264b9-4e67-4881-989a-b86ec84bf887 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:50.200476 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-586264b9-4e67-4881-989a-b86ec84bf887 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:50.201629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-586264b9-4e67-4881-989a-b86ec84bf887 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:50.201759 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-586264b9-4e67-4881-989a-b86ec84bf887 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:50.202220 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-586264b9-4e67-4881-989a-b86ec84bf887 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:50.202647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-586264b9-4e67-4881-989a-b86ec84bf887 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:50.409961 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-586264b9-4e67-4881-989a-b86ec84bf887 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:50.417520 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-586264b9-4e67-4881-989a-b86ec84bf887 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1314 microversion: 2.1 time: 0.229799 Sep 14 12:21:50.418117 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 610/1225] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:50 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:51.442088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d7a44187-9ff4-4a35-b769-152c13ba770f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:51.443320 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d7a44187-9ff4-4a35-b769-152c13ba770f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:51.449478 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7a44187-9ff4-4a35-b769-152c13ba770f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:51.450007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7a44187-9ff4-4a35-b769-152c13ba770f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:51.450451 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7a44187-9ff4-4a35-b769-152c13ba770f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:51.451141 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7a44187-9ff4-4a35-b769-152c13ba770f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:51.451595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7a44187-9ff4-4a35-b769-152c13ba770f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:51.452023 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d7a44187-9ff4-4a35-b769-152c13ba770f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:51.580584 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d7a44187-9ff4-4a35-b769-152c13ba770f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:51.588897 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d7a44187-9ff4-4a35-b769-152c13ba770f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1314 microversion: 2.1 time: 0.151555 Sep 14 12:21:51.589466 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 616/1226] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:51 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:52.612026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1aa4d182-6796-4e80-863d-89f425b950d3 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:52.612653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1aa4d182-6796-4e80-863d-89f425b950d3 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:52.619349 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4d182-6796-4e80-863d-89f425b950d3 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:52.619838 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4d182-6796-4e80-863d-89f425b950d3 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:52.620280 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4d182-6796-4e80-863d-89f425b950d3 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:52.620974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4d182-6796-4e80-863d-89f425b950d3 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:52.621431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4d182-6796-4e80-863d-89f425b950d3 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:52.621879 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1aa4d182-6796-4e80-863d-89f425b950d3 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:52.750181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1aa4d182-6796-4e80-863d-89f425b950d3 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:52.758467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1aa4d182-6796-4e80-863d-89f425b950d3 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1314 microversion: 2.1 time: 0.150585 Sep 14 12:21:52.759040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 611/1227] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:52 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:53.781070 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-af6a13e4-e44c-42c2-b3b2-825fb61bca95 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:53.781727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-af6a13e4-e44c-42c2-b3b2-825fb61bca95 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:53.788443 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af6a13e4-e44c-42c2-b3b2-825fb61bca95 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:53.788929 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af6a13e4-e44c-42c2-b3b2-825fb61bca95 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:53.789374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af6a13e4-e44c-42c2-b3b2-825fb61bca95 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:53.790106 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af6a13e4-e44c-42c2-b3b2-825fb61bca95 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:53.790561 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af6a13e4-e44c-42c2-b3b2-825fb61bca95 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:53.791015 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af6a13e4-e44c-42c2-b3b2-825fb61bca95 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:53.922977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-af6a13e4-e44c-42c2-b3b2-825fb61bca95 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:53.931706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-af6a13e4-e44c-42c2-b3b2-825fb61bca95 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1314 microversion: 2.1 time: 0.154329 Sep 14 12:21:53.932249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 617/1228] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:53 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:54.956437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-be2139d8-6d8b-468a-b670-bbee3fb4755f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:54.957026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-be2139d8-6d8b-468a-b670-bbee3fb4755f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:54.963452 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2139d8-6d8b-468a-b670-bbee3fb4755f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:54.963932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2139d8-6d8b-468a-b670-bbee3fb4755f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:54.964362 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2139d8-6d8b-468a-b670-bbee3fb4755f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:54.965046 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2139d8-6d8b-468a-b670-bbee3fb4755f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:54.965500 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2139d8-6d8b-468a-b670-bbee3fb4755f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:54.965947 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-be2139d8-6d8b-468a-b670-bbee3fb4755f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:55.094794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-be2139d8-6d8b-468a-b670-bbee3fb4755f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:55.102873 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-be2139d8-6d8b-468a-b670-bbee3fb4755f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1314 microversion: 2.1 time: 0.150336 Sep 14 12:21:55.103453 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 612/1229] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:54 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:56.126313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-12fedb98-f7f5-46cb-9963-dd9ac6ee1248 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:56.126944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-12fedb98-f7f5-46cb-9963-dd9ac6ee1248 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:56.129539 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:56.134489 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-12fedb98-f7f5-46cb-9963-dd9ac6ee1248 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:56.144691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-12fedb98-f7f5-46cb-9963-dd9ac6ee1248 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:56.144691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-12fedb98-f7f5-46cb-9963-dd9ac6ee1248 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:56.144691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-12fedb98-f7f5-46cb-9963-dd9ac6ee1248 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:56.144691 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-12fedb98-f7f5-46cb-9963-dd9ac6ee1248 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:56.145121 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-12fedb98-f7f5-46cb-9963-dd9ac6ee1248 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:56.275653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-12fedb98-f7f5-46cb-9963-dd9ac6ee1248 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:56.283462 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-12fedb98-f7f5-46cb-9963-dd9ac6ee1248 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1314 microversion: 2.1 time: 0.161190 Sep 14 12:21:56.284032 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 618/1230] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:56 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:57.307303 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6e10b4e4-636e-455d-87c6-eade4c7c33b4 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:57.307899 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6e10b4e4-636e-455d-87c6-eade4c7c33b4 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:57.310039 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:57.310796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=6 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:57.316193 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e10b4e4-636e-455d-87c6-eade4c7c33b4 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:57.316690 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e10b4e4-636e-455d-87c6-eade4c7c33b4 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:57.317125 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e10b4e4-636e-455d-87c6-eade4c7c33b4 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:57.318368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e10b4e4-636e-455d-87c6-eade4c7c33b4 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:57.318827 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e10b4e4-636e-455d-87c6-eade4c7c33b4 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:57.319257 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6e10b4e4-636e-455d-87c6-eade4c7c33b4 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:57.448496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6e10b4e4-636e-455d-87c6-eade4c7c33b4 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:57.456184 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6e10b4e4-636e-455d-87c6-eade4c7c33b4 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1314 microversion: 2.1 time: 0.152762 Sep 14 12:21:57.457984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 613/1231] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:57 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:57.813367 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-0abf13bf-5b1b-4bff-b0c6-d9c82142d315 req-1e8ea8dd-f35e-4202-829e-81ac0ecdf18b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9211e016-bd66-474d-9b1c-20ce2b43dabe", "name": "network-vif-plugged", "status": "completed", "tag": "640989ff-0263-4c2e-b610-171e3cd91406"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:21:57.824484 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-0abf13bf-5b1b-4bff-b0c6-d9c82142d315 req-1e8ea8dd-f35e-4202-829e-81ac0ecdf18b service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:57.824978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-0abf13bf-5b1b-4bff-b0c6-d9c82142d315 req-1e8ea8dd-f35e-4202-829e-81ac0ecdf18b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:57.825674 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-0abf13bf-5b1b-4bff-b0c6-d9c82142d315 req-1e8ea8dd-f35e-4202-829e-81ac0ecdf18b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:57.836987 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-0abf13bf-5b1b-4bff-b0c6-d9c82142d315 req-1e8ea8dd-f35e-4202-829e-81ac0ecdf18b service nova] Creating event network-vif-plugged:640989ff-0263-4c2e-b610-171e3cd91406 for instance 9211e016-bd66-474d-9b1c-20ce2b43dabe on hv-cinder-84496 Sep 14 12:21:57.842236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-0abf13bf-5b1b-4bff-b0c6-d9c82142d315 req-1e8ea8dd-f35e-4202-829e-81ac0ecdf18b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 Sep 14 12:21:57.843097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 619/1232] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:21:58.479951 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-83000cf9-73a5-4a01-a0f6-a4d727a6068f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:58.480536 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-83000cf9-73a5-4a01-a0f6-a4d727a6068f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:58.486809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83000cf9-73a5-4a01-a0f6-a4d727a6068f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:58.487289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83000cf9-73a5-4a01-a0f6-a4d727a6068f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:58.487721 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83000cf9-73a5-4a01-a0f6-a4d727a6068f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:58.488405 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83000cf9-73a5-4a01-a0f6-a4d727a6068f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:58.488856 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83000cf9-73a5-4a01-a0f6-a4d727a6068f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:58.489335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-83000cf9-73a5-4a01-a0f6-a4d727a6068f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:58.618815 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-83000cf9-73a5-4a01-a0f6-a4d727a6068f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:58.626367 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-83000cf9-73a5-4a01-a0f6-a4d727a6068f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1314 microversion: 2.1 time: 0.150694 Sep 14 12:21:58.626976 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 614/1233] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:58 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:21:59.651411 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-efbfb3c8-2d33-4212-8bc5-6c7105728554 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:21:59.652110 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-efbfb3c8-2d33-4212-8bc5-6c7105728554 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:21:59.658883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbfb3c8-2d33-4212-8bc5-6c7105728554 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:59.659359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbfb3c8-2d33-4212-8bc5-6c7105728554 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:59.659792 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbfb3c8-2d33-4212-8bc5-6c7105728554 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:59.660479 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbfb3c8-2d33-4212-8bc5-6c7105728554 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:21:59.660930 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbfb3c8-2d33-4212-8bc5-6c7105728554 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:21:59.661384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-efbfb3c8-2d33-4212-8bc5-6c7105728554 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:21:59.791393 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-efbfb3c8-2d33-4212-8bc5-6c7105728554 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:21:59.799615 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-efbfb3c8-2d33-4212-8bc5-6c7105728554 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1314 microversion: 2.1 time: 0.152393 Sep 14 12:21:59.800192 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 620/1234] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:21:59 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:00.823323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3857ca79-d449-49b2-98d4-e4b3a6a01245 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:00.823944 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3857ca79-d449-49b2-98d4-e4b3a6a01245 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:00.830711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3857ca79-d449-49b2-98d4-e4b3a6a01245 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:00.831204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3857ca79-d449-49b2-98d4-e4b3a6a01245 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:00.831660 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3857ca79-d449-49b2-98d4-e4b3a6a01245 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:00.832458 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3857ca79-d449-49b2-98d4-e4b3a6a01245 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:00.832915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3857ca79-d449-49b2-98d4-e4b3a6a01245 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:00.833346 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3857ca79-d449-49b2-98d4-e4b3a6a01245 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:00.969446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3857ca79-d449-49b2-98d4-e4b3a6a01245 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:00.978038 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3857ca79-d449-49b2-98d4-e4b3a6a01245 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1463 microversion: 2.1 time: 0.158704 Sep 14 12:22:00.978608 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 615/1235] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:00 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:01.024700 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1f7ec0d9-4452-4417-b92b-1355e28e26b1 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:01.025225 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1f7ec0d9-4452-4417-b92b-1355e28e26b1 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:01.031714 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1f7ec0d9-4452-4417-b92b-1355e28e26b1 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:01.032198 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1f7ec0d9-4452-4417-b92b-1355e28e26b1 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:01.032644 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1f7ec0d9-4452-4417-b92b-1355e28e26b1 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:01.033330 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1f7ec0d9-4452-4417-b92b-1355e28e26b1 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:01.033802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1f7ec0d9-4452-4417-b92b-1355e28e26b1 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:01.034267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1f7ec0d9-4452-4417-b92b-1355e28e26b1 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:01.059357 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1f7ec0d9-4452-4417-b92b-1355e28e26b1 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Going to try to terminate instance {{(pid=121152) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:22:01.308761 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1f7ec0d9-4452-4417-b92b-1355e28e26b1 tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 204 len: 0 microversion: 2.1 time: 0.288186 Sep 14 12:22:01.309359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 621/1236] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:22:01 2022] DELETE /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:22:01.317694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3d41d745-b5ff-4a97-aade-f1125b87b9fb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:01.318406 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3d41d745-b5ff-4a97-aade-f1125b87b9fb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:01.325150 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d41d745-b5ff-4a97-aade-f1125b87b9fb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:01.325794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d41d745-b5ff-4a97-aade-f1125b87b9fb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:01.328339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d41d745-b5ff-4a97-aade-f1125b87b9fb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:01.328339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d41d745-b5ff-4a97-aade-f1125b87b9fb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:01.328339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d41d745-b5ff-4a97-aade-f1125b87b9fb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:01.328339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3d41d745-b5ff-4a97-aade-f1125b87b9fb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:01.457145 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3d41d745-b5ff-4a97-aade-f1125b87b9fb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:01.464727 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3d41d745-b5ff-4a97-aade-f1125b87b9fb tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1469 microversion: 2.1 time: 0.150976 Sep 14 12:22:01.465291 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 616/1237] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:01 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:02.488124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-721c5335-d503-4c68-bff2-b7e3226a100f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:02.488748 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-721c5335-d503-4c68-bff2-b7e3226a100f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:02.495992 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721c5335-d503-4c68-bff2-b7e3226a100f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:02.496478 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721c5335-d503-4c68-bff2-b7e3226a100f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:02.496915 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721c5335-d503-4c68-bff2-b7e3226a100f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:02.497609 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721c5335-d503-4c68-bff2-b7e3226a100f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:02.498093 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721c5335-d503-4c68-bff2-b7e3226a100f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:02.498519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-721c5335-d503-4c68-bff2-b7e3226a100f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:02.631368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-721c5335-d503-4c68-bff2-b7e3226a100f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:02.639280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-721c5335-d503-4c68-bff2-b7e3226a100f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1469 microversion: 2.1 time: 0.155662 Sep 14 12:22:02.639879 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 622/1238] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:02 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:03.664056 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5a4c30ed-2280-4f43-9493-4621ee30b65f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:03.664641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5a4c30ed-2280-4f43-9493-4621ee30b65f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:03.671309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a4c30ed-2280-4f43-9493-4621ee30b65f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:03.671803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a4c30ed-2280-4f43-9493-4621ee30b65f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:03.672242 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a4c30ed-2280-4f43-9493-4621ee30b65f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:03.672946 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a4c30ed-2280-4f43-9493-4621ee30b65f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:03.673405 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a4c30ed-2280-4f43-9493-4621ee30b65f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:03.673834 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5a4c30ed-2280-4f43-9493-4621ee30b65f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:03.883151 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5a4c30ed-2280-4f43-9493-4621ee30b65f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:03.894221 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-6df8cb1a-a223-4cf9-96ab-e6cc41d605a4 req-63584436-f7b5-410e-bfa6-97a1bed8fa04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9211e016-bd66-474d-9b1c-20ce2b43dabe", "name": "network-vif-deleted", "tag": "640989ff-0263-4c2e-b610-171e3cd91406"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:22:03.896110 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5a4c30ed-2280-4f43-9493-4621ee30b65f tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1469 microversion: 2.1 time: 0.235836 Sep 14 12:22:03.896697 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 617/1239] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:03 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1469 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:22:03.908301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6df8cb1a-a223-4cf9-96ab-e6cc41d605a4 req-63584436-f7b5-410e-bfa6-97a1bed8fa04 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:03.908782 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6df8cb1a-a223-4cf9-96ab-e6cc41d605a4 req-63584436-f7b5-410e-bfa6-97a1bed8fa04 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:03.909209 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6df8cb1a-a223-4cf9-96ab-e6cc41d605a4 req-63584436-f7b5-410e-bfa6-97a1bed8fa04 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:03.921549 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-6df8cb1a-a223-4cf9-96ab-e6cc41d605a4 req-63584436-f7b5-410e-bfa6-97a1bed8fa04 service nova] Creating event network-vif-deleted:640989ff-0263-4c2e-b610-171e3cd91406 for instance 9211e016-bd66-474d-9b1c-20ce2b43dabe on hv-cinder-84496 Sep 14 12:22:03.927111 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-6df8cb1a-a223-4cf9-96ab-e6cc41d605a4 req-63584436-f7b5-410e-bfa6-97a1bed8fa04 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036927 Sep 14 12:22:03.927740 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 623/1240] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:22:04.919362 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:04.919984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:04.926670 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:04.927157 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:04.927641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:04.928333 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:04.928786 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:04.929214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:04.962233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:04.962722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:04.963167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:04.963606 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lazy-loading 'fault' on Instance uuid 9211e016-bd66-474d-9b1c-20ce2b43dabe {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:22:05.003995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbebfb828cb410a818a87a9bb5717cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a46571f6a64b65aa0e37f67cfdae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:05.012815 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7d9c1040-a8ba-47b3-95bf-ed22306e394c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 200 len: 1304 microversion: 2.1 time: 0.097332 Sep 14 12:22:05.013384 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 618/1241] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:04 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:06.043944 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:06.044650 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] [instance: 9211e016-bd66-474d-9b1c-20ce2b43dabe] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:06.050912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:06.051388 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:06.051821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:06.052508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:06.052960 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:06.053386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:06.066677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] HTTP exception thrown: Instance 9211e016-bd66-474d-9b1c-20ce2b43dabe could not be found. Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Request method failure captured: Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe HTTP/1.1 Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcdV81f0FbGXbebGhRqIWvaaQPn2zIP8c6I1lCy_yn1HBBGQqmYJd81rxt3B5B7aFu72rcTBwpjdSJNSAh8boJiIL6No_aBwgnILHh59EQxJ7T7-vla1lTX8rO4fVJSfpdmqREkfMOPcenqkF71FyTlOvyE1qEAiUNdsxPvtirZAuAU Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: 33a46571f6a64b65aa0e37f67cfdae0c Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-VolumesNegativeTest-1030049738 Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:22:06.068458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/33a46571f6a64b65aa0e37f67cfdae0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/33a46571f6a64b65aa0e37f67cfdae0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_33a46571f6a64b65aa0e37f67cfdae0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/33a46571f6a64b65aa0e37f67cfdae0c"}]}] Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-VolumesNegativeTest-1030049738 Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: 33a46571f6a64b65aa0e37f67cfdae0c Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-VolumesNegativeTest-1030049738 Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-VolumesNegativeTest-1030049738-project Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 0bbebfb828cb410a818a87a9bb5717cd Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-VolumesNegativeTest-1030049738-project Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 9211e016-bd66-474d-9b1c-20ce2b43dabe could not be found. Sep 14 12:22:06.070076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '9211e016-bd66-474d-9b1c-20ce2b43dabe'} Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9211e016-bd66-474d-9b1c-20ce2b43dabe could not be found. Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:22:06.071038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9211e016-bd66-474d-9b1c-20ce2b43dabe could not be found. Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9211e016-bd66-474d-9b1c-20ce2b43dabe could not be found. Sep 14 12:22:06.072802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:22:06.074415 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] Returning 404 to user: Instance 9211e016-bd66-474d-9b1c-20ce2b43dabe could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:22:06.074415 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-aec179e0-86b7-476d-920f-5a92c5edfe2c tempest-VolumesNegativeTest-1030049738 tempest-VolumesNegativeTest-1030049738-project] 10.222.0.62 "GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe" status: 404 len: 111 microversion: 2.1 time: 0.031269 Sep 14 12:22:06.074415 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 624/1242] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:06 2022] GET /compute/v2.1/servers/9211e016-bd66-474d-9b1c-20ce2b43dabe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:22:28.141822 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0d76921f-c845-4475-be48-6380d12d66cd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:22:28.152446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0d76921f-c845-4475-be48-6380d12d66cd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:28.152446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:28.152446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=70 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:28.152446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d76921f-c845-4475-be48-6380d12d66cd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:28.152446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d76921f-c845-4475-be48-6380d12d66cd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:28.152937 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d76921f-c845-4475-be48-6380d12d66cd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:28.153054 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d76921f-c845-4475-be48-6380d12d66cd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:28.154175 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d76921f-c845-4475-be48-6380d12d66cd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:28.154641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0d76921f-c845-4475-be48-6380d12d66cd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:28.178989 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-0d76921f-c845-4475-be48-6380d12d66cd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lazy-loading 'flavor' on Instance uuid 921553b2-7c2b-4ec6-80c9-23298af50994 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:22:28.475022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0d76921f-c845-4475-be48-6380d12d66cd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "POST /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994/action" status: 202 len: 0 microversion: 2.1 time: 0.337368 Sep 14 12:22:28.475720 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 619/1243] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:22:28 2022] POST /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:22:28.485570 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8c9bd2df-c861-48a1-a781-ca5bcbf8e906 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:28.486483 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8c9bd2df-c861-48a1-a781-ca5bcbf8e906 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:28.488616 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:28.489437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:28.494433 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c9bd2df-c861-48a1-a781-ca5bcbf8e906 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:28.494913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c9bd2df-c861-48a1-a781-ca5bcbf8e906 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:28.495516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c9bd2df-c861-48a1-a781-ca5bcbf8e906 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:28.496192 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c9bd2df-c861-48a1-a781-ca5bcbf8e906 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:28.496647 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c9bd2df-c861-48a1-a781-ca5bcbf8e906 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:28.497573 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8c9bd2df-c861-48a1-a781-ca5bcbf8e906 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:28.640881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8c9bd2df-c861-48a1-a781-ca5bcbf8e906 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:28.650034 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8c9bd2df-c861-48a1-a781-ca5bcbf8e906 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.168808 Sep 14 12:22:28.651268 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 625/1244] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:28 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:29.675153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2f80b6b2-af45-41e0-95c5-76cccd6d8409 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:29.675861 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2f80b6b2-af45-41e0-95c5-76cccd6d8409 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:29.682787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f80b6b2-af45-41e0-95c5-76cccd6d8409 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:29.683282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f80b6b2-af45-41e0-95c5-76cccd6d8409 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:29.683714 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f80b6b2-af45-41e0-95c5-76cccd6d8409 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:29.684447 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f80b6b2-af45-41e0-95c5-76cccd6d8409 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:29.684897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f80b6b2-af45-41e0-95c5-76cccd6d8409 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:29.685323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2f80b6b2-af45-41e0-95c5-76cccd6d8409 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:29.843758 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2f80b6b2-af45-41e0-95c5-76cccd6d8409 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:29.852375 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2f80b6b2-af45-41e0-95c5-76cccd6d8409 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.182247 Sep 14 12:22:29.852948 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 620/1245] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:29 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:30.876657 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3a1d7533-8eb7-4d6e-9311-a16a5cd3845f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:30.877270 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3a1d7533-8eb7-4d6e-9311-a16a5cd3845f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:30.885017 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1d7533-8eb7-4d6e-9311-a16a5cd3845f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:30.885500 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1d7533-8eb7-4d6e-9311-a16a5cd3845f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:30.885959 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1d7533-8eb7-4d6e-9311-a16a5cd3845f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:30.886653 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1d7533-8eb7-4d6e-9311-a16a5cd3845f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:30.887100 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1d7533-8eb7-4d6e-9311-a16a5cd3845f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:30.887575 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a1d7533-8eb7-4d6e-9311-a16a5cd3845f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:31.026904 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3a1d7533-8eb7-4d6e-9311-a16a5cd3845f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:31.034732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3a1d7533-8eb7-4d6e-9311-a16a5cd3845f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.163059 Sep 14 12:22:31.035303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 626/1246] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:30 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:32.058953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7b9af1ea-4eb6-40b3-87b2-edcd314162d6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:32.059557 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7b9af1ea-4eb6-40b3-87b2-edcd314162d6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:32.066513 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b9af1ea-4eb6-40b3-87b2-edcd314162d6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:32.067019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b9af1ea-4eb6-40b3-87b2-edcd314162d6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:32.067455 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b9af1ea-4eb6-40b3-87b2-edcd314162d6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:32.068130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b9af1ea-4eb6-40b3-87b2-edcd314162d6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:32.068577 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b9af1ea-4eb6-40b3-87b2-edcd314162d6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:32.069024 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7b9af1ea-4eb6-40b3-87b2-edcd314162d6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:32.198962 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7b9af1ea-4eb6-40b3-87b2-edcd314162d6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:32.207226 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7b9af1ea-4eb6-40b3-87b2-edcd314162d6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.152100 Sep 14 12:22:32.207801 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 621/1247] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:32 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:33.230724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7a2f3079-f8a1-436d-adce-5c5101c672d8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:33.231339 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7a2f3079-f8a1-436d-adce-5c5101c672d8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:33.238335 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7a2f3079-f8a1-436d-adce-5c5101c672d8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:33.238818 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7a2f3079-f8a1-436d-adce-5c5101c672d8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:33.239255 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7a2f3079-f8a1-436d-adce-5c5101c672d8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:33.240066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7a2f3079-f8a1-436d-adce-5c5101c672d8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:33.240524 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7a2f3079-f8a1-436d-adce-5c5101c672d8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:33.240949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7a2f3079-f8a1-436d-adce-5c5101c672d8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:33.377322 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-7a2f3079-f8a1-436d-adce-5c5101c672d8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:33.385772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7a2f3079-f8a1-436d-adce-5c5101c672d8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.158950 Sep 14 12:22:33.386420 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 627/1248] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:33 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:34.422875 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d55bf02b-dd39-4f35-ab64-6a015e330d8f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:34.423505 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d55bf02b-dd39-4f35-ab64-6a015e330d8f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:34.434424 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d55bf02b-dd39-4f35-ab64-6a015e330d8f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:34.434960 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d55bf02b-dd39-4f35-ab64-6a015e330d8f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:34.435402 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d55bf02b-dd39-4f35-ab64-6a015e330d8f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:34.436217 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d55bf02b-dd39-4f35-ab64-6a015e330d8f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:34.436705 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d55bf02b-dd39-4f35-ab64-6a015e330d8f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:34.437140 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d55bf02b-dd39-4f35-ab64-6a015e330d8f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:34.583699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d55bf02b-dd39-4f35-ab64-6a015e330d8f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:34.591607 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d55bf02b-dd39-4f35-ab64-6a015e330d8f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.173483 Sep 14 12:22:34.592200 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 622/1249] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:34 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:35.616199 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fe466e1f-9ef3-42d8-b996-d5d0cfa3696c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:35.616859 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-fe466e1f-9ef3-42d8-b996-d5d0cfa3696c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:35.623796 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fe466e1f-9ef3-42d8-b996-d5d0cfa3696c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:35.624284 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fe466e1f-9ef3-42d8-b996-d5d0cfa3696c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:35.624722 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fe466e1f-9ef3-42d8-b996-d5d0cfa3696c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:35.625424 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fe466e1f-9ef3-42d8-b996-d5d0cfa3696c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:35.625901 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fe466e1f-9ef3-42d8-b996-d5d0cfa3696c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:35.626336 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fe466e1f-9ef3-42d8-b996-d5d0cfa3696c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:35.763501 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fe466e1f-9ef3-42d8-b996-d5d0cfa3696c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:35.772231 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-fe466e1f-9ef3-42d8-b996-d5d0cfa3696c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.160084 Sep 14 12:22:35.772805 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 628/1250] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:35 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:36.796920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-48e300ed-5635-46cf-8626-abed151c57bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:36.797594 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-48e300ed-5635-46cf-8626-abed151c57bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:36.804036 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48e300ed-5635-46cf-8626-abed151c57bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:36.804529 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48e300ed-5635-46cf-8626-abed151c57bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:36.804987 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48e300ed-5635-46cf-8626-abed151c57bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:36.805642 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48e300ed-5635-46cf-8626-abed151c57bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:36.806126 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48e300ed-5635-46cf-8626-abed151c57bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:36.806548 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-48e300ed-5635-46cf-8626-abed151c57bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:36.939255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-48e300ed-5635-46cf-8626-abed151c57bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:36.947246 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-48e300ed-5635-46cf-8626-abed151c57bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.154769 Sep 14 12:22:36.947843 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 623/1251] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:36 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:37.972797 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c11a97b3-bc01-43ce-868e-e98e25bfe634 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:37.973464 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c11a97b3-bc01-43ce-868e-e98e25bfe634 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:37.979956 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c11a97b3-bc01-43ce-868e-e98e25bfe634 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:37.980440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c11a97b3-bc01-43ce-868e-e98e25bfe634 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:37.980883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c11a97b3-bc01-43ce-868e-e98e25bfe634 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:37.981578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c11a97b3-bc01-43ce-868e-e98e25bfe634 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:37.982063 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c11a97b3-bc01-43ce-868e-e98e25bfe634 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:37.982487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c11a97b3-bc01-43ce-868e-e98e25bfe634 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:38.122224 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c11a97b3-bc01-43ce-868e-e98e25bfe634 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:38.130488 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c11a97b3-bc01-43ce-868e-e98e25bfe634 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.161716 Sep 14 12:22:38.131041 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 629/1252] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:37 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:22:39.154813 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-377a509d-b5db-4d4f-b6d2-e789e82ba15f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:39.155381 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-377a509d-b5db-4d4f-b6d2-e789e82ba15f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:39.162347 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-377a509d-b5db-4d4f-b6d2-e789e82ba15f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:39.162839 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-377a509d-b5db-4d4f-b6d2-e789e82ba15f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:39.163526 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-377a509d-b5db-4d4f-b6d2-e789e82ba15f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:39.164098 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-377a509d-b5db-4d4f-b6d2-e789e82ba15f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:39.164649 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-377a509d-b5db-4d4f-b6d2-e789e82ba15f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:39.164980 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-377a509d-b5db-4d4f-b6d2-e789e82ba15f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:39.308845 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-377a509d-b5db-4d4f-b6d2-e789e82ba15f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:39.317333 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-377a509d-b5db-4d4f-b6d2-e789e82ba15f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.166699 Sep 14 12:22:39.317932 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 624/1253] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:39 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:40.341016 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f185d97f-b16a-4562-8e2d-164f29aed443 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:40.341683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f185d97f-b16a-4562-8e2d-164f29aed443 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:40.348569 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f185d97f-b16a-4562-8e2d-164f29aed443 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:40.349047 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f185d97f-b16a-4562-8e2d-164f29aed443 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:40.349475 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f185d97f-b16a-4562-8e2d-164f29aed443 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:40.350195 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f185d97f-b16a-4562-8e2d-164f29aed443 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:40.350642 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f185d97f-b16a-4562-8e2d-164f29aed443 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:40.351056 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f185d97f-b16a-4562-8e2d-164f29aed443 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:40.496357 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f185d97f-b16a-4562-8e2d-164f29aed443 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:40.505810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f185d97f-b16a-4562-8e2d-164f29aed443 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.168612 Sep 14 12:22:40.513307 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 630/1254] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:40 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:41.530255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ce485692-cce9-4c46-ba19-1d60109b1ecb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:41.530887 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ce485692-cce9-4c46-ba19-1d60109b1ecb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:41.540235 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce485692-cce9-4c46-ba19-1d60109b1ecb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:41.541114 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce485692-cce9-4c46-ba19-1d60109b1ecb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:41.541903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce485692-cce9-4c46-ba19-1d60109b1ecb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:41.542990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce485692-cce9-4c46-ba19-1d60109b1ecb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:41.543574 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce485692-cce9-4c46-ba19-1d60109b1ecb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:41.544322 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ce485692-cce9-4c46-ba19-1d60109b1ecb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:41.690532 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ce485692-cce9-4c46-ba19-1d60109b1ecb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:41.699002 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ce485692-cce9-4c46-ba19-1d60109b1ecb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.172619 Sep 14 12:22:41.700295 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 625/1255] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:41 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:42.725404 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-eb85b58c-d408-4805-b534-a7390b3b35f6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:42.726053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-eb85b58c-d408-4805-b534-a7390b3b35f6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:42.732513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb85b58c-d408-4805-b534-a7390b3b35f6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:42.733001 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb85b58c-d408-4805-b534-a7390b3b35f6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:42.733438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb85b58c-d408-4805-b534-a7390b3b35f6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:42.734157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb85b58c-d408-4805-b534-a7390b3b35f6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:42.734612 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb85b58c-d408-4805-b534-a7390b3b35f6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:42.735132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-eb85b58c-d408-4805-b534-a7390b3b35f6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:42.922884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-eb85b58c-d408-4805-b534-a7390b3b35f6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:42.931105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-eb85b58c-d408-4805-b534-a7390b3b35f6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.209661 Sep 14 12:22:42.931689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 631/1256] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:42 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:43.956631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-77df8639-b201-44fa-a7c1-d128a915c0d3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:43.957391 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-77df8639-b201-44fa-a7c1-d128a915c0d3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:43.964425 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77df8639-b201-44fa-a7c1-d128a915c0d3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:43.964924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77df8639-b201-44fa-a7c1-d128a915c0d3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:43.965369 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77df8639-b201-44fa-a7c1-d128a915c0d3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:43.966109 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77df8639-b201-44fa-a7c1-d128a915c0d3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:43.966611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77df8639-b201-44fa-a7c1-d128a915c0d3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:43.967045 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-77df8639-b201-44fa-a7c1-d128a915c0d3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:44.117397 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-77df8639-b201-44fa-a7c1-d128a915c0d3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:44.130747 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-77df8639-b201-44fa-a7c1-d128a915c0d3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.178020 Sep 14 12:22:44.131496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 626/1257] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:43 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:45.157534 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5c1a1d1a-4179-48e5-b378-e33dc463ee94 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:45.158162 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5c1a1d1a-4179-48e5-b378-e33dc463ee94 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:45.168353 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c1a1d1a-4179-48e5-b378-e33dc463ee94 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:45.169106 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c1a1d1a-4179-48e5-b378-e33dc463ee94 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:45.170157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c1a1d1a-4179-48e5-b378-e33dc463ee94 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:45.170997 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c1a1d1a-4179-48e5-b378-e33dc463ee94 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:45.171451 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c1a1d1a-4179-48e5-b378-e33dc463ee94 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:45.171871 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5c1a1d1a-4179-48e5-b378-e33dc463ee94 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:45.355673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5c1a1d1a-4179-48e5-b378-e33dc463ee94 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:45.370188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5c1a1d1a-4179-48e5-b378-e33dc463ee94 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.216875 Sep 14 12:22:45.370784 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 632/1258] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:45 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:46.400010 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1b2918d8-b5a0-4661-8849-c754ba4b6970 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:46.401259 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1b2918d8-b5a0-4661-8849-c754ba4b6970 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:46.408153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b2918d8-b5a0-4661-8849-c754ba4b6970 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:46.409015 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b2918d8-b5a0-4661-8849-c754ba4b6970 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:46.409647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b2918d8-b5a0-4661-8849-c754ba4b6970 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:46.410713 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b2918d8-b5a0-4661-8849-c754ba4b6970 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:46.411346 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b2918d8-b5a0-4661-8849-c754ba4b6970 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:46.412103 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1b2918d8-b5a0-4661-8849-c754ba4b6970 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:46.565261 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1b2918d8-b5a0-4661-8849-c754ba4b6970 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:46.573823 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1b2918d8-b5a0-4661-8849-c754ba4b6970 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.180508 Sep 14 12:22:46.574638 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 627/1259] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:46 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:22:47.598937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2d1f7ee5-08d0-4bc5-a1d3-e3e05595ee02 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:47.600307 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2d1f7ee5-08d0-4bc5-a1d3-e3e05595ee02 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:47.607239 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d1f7ee5-08d0-4bc5-a1d3-e3e05595ee02 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:47.607730 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d1f7ee5-08d0-4bc5-a1d3-e3e05595ee02 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:47.608170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d1f7ee5-08d0-4bc5-a1d3-e3e05595ee02 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:47.608881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d1f7ee5-08d0-4bc5-a1d3-e3e05595ee02 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:47.609842 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d1f7ee5-08d0-4bc5-a1d3-e3e05595ee02 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:47.610115 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d1f7ee5-08d0-4bc5-a1d3-e3e05595ee02 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:47.897149 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d1f7ee5-08d0-4bc5-a1d3-e3e05595ee02 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:47.909323 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2d1f7ee5-08d0-4bc5-a1d3-e3e05595ee02 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.314310 Sep 14 12:22:47.912777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 633/1260] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:47 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:48.940326 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ac201666-883e-486d-98a9-2291f6fa12ec tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:48.940959 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ac201666-883e-486d-98a9-2291f6fa12ec tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:48.947612 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac201666-883e-486d-98a9-2291f6fa12ec tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:48.948103 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac201666-883e-486d-98a9-2291f6fa12ec tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:48.948543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac201666-883e-486d-98a9-2291f6fa12ec tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:48.949255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac201666-883e-486d-98a9-2291f6fa12ec tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:48.949707 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac201666-883e-486d-98a9-2291f6fa12ec tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:48.952029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ac201666-883e-486d-98a9-2291f6fa12ec tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:49.110034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ac201666-883e-486d-98a9-2291f6fa12ec tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:49.119577 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ac201666-883e-486d-98a9-2291f6fa12ec tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.185812 Sep 14 12:22:49.129914 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 628/1261] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:48 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:50.144758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-905608f1-ae17-4e18-9092-267db611623d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:50.146075 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-905608f1-ae17-4e18-9092-267db611623d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:50.153672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-905608f1-ae17-4e18-9092-267db611623d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:50.154923 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-905608f1-ae17-4e18-9092-267db611623d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:50.155456 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-905608f1-ae17-4e18-9092-267db611623d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:50.156210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-905608f1-ae17-4e18-9092-267db611623d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:50.156786 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-905608f1-ae17-4e18-9092-267db611623d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:50.157217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-905608f1-ae17-4e18-9092-267db611623d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:50.325645 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-905608f1-ae17-4e18-9092-267db611623d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:50.340431 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-905608f1-ae17-4e18-9092-267db611623d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.199971 Sep 14 12:22:50.341461 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 634/1262] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:50 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:51.366776 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-50e0d558-50f4-4b00-ab16-4d1044c29853 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:51.368682 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-50e0d558-50f4-4b00-ab16-4d1044c29853 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:51.381706 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50e0d558-50f4-4b00-ab16-4d1044c29853 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:51.382468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50e0d558-50f4-4b00-ab16-4d1044c29853 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:51.383089 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50e0d558-50f4-4b00-ab16-4d1044c29853 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:51.384233 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50e0d558-50f4-4b00-ab16-4d1044c29853 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:51.384676 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50e0d558-50f4-4b00-ab16-4d1044c29853 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:51.385253 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50e0d558-50f4-4b00-ab16-4d1044c29853 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:51.647369 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-50e0d558-50f4-4b00-ab16-4d1044c29853 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:51.658264 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-50e0d558-50f4-4b00-ab16-4d1044c29853 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1568 microversion: 2.1 time: 0.297134 Sep 14 12:22:51.672264 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 629/1263] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:51 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1568 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:51.689694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:22:51.690464 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:51.698202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:51.698693 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:51.699123 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:51.700084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:51.700793 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:51.701418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:51.802261 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121152) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 12:22:52.267256 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [5fa93e0e-1ad3-48c3-abbc-3b984d7abb4d] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 12:22:53.276377 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO oslo.messaging._drivers.impl_rabbit [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [5fa93e0e-1ad3-48c3-abbc-3b984d7abb4d] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 59256. Sep 14 12:22:53.282151 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f2d82e73-2c15-43a3-9f34-a8484c893add tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "POST /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994/action" status: 202 len: 0 microversion: 2.1 time: 1.597017 Sep 14 12:22:53.282783 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 635/1264] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:22:51 2022] POST /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994/action => generated 0 bytes in 1599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 12:22:53.291189 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ae97258d-b15b-4a49-ae15-379521df54b3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:53.291809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ae97258d-b15b-4a49-ae15-379521df54b3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:53.319107 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae97258d-b15b-4a49-ae15-379521df54b3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:53.322336 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae97258d-b15b-4a49-ae15-379521df54b3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:53.323092 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae97258d-b15b-4a49-ae15-379521df54b3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:53.324253 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae97258d-b15b-4a49-ae15-379521df54b3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:53.325040 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae97258d-b15b-4a49-ae15-379521df54b3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:53.326629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae97258d-b15b-4a49-ae15-379521df54b3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:53.606259 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ae97258d-b15b-4a49-ae15-379521df54b3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:53.621738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ae97258d-b15b-4a49-ae15-379521df54b3 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1516 microversion: 2.1 time: 0.334420 Sep 14 12:22:53.634131 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 630/1265] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:53 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1516 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:22:54.265745 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-f4614a3d-8f8d-46ea-b19a-cfe78e697626 req-00ff5f31-397e-459d-852b-5833916ab039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921553b2-7c2b-4ec6-80c9-23298af50994", "name": "network-vif-unplugged", "status": "completed", "tag": "f37c6abe-5567-400c-b0bd-04c3772b1a60"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:22:54.286612 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-f4614a3d-8f8d-46ea-b19a-cfe78e697626 req-00ff5f31-397e-459d-852b-5833916ab039 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:54.287238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-f4614a3d-8f8d-46ea-b19a-cfe78e697626 req-00ff5f31-397e-459d-852b-5833916ab039 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:54.287518 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-f4614a3d-8f8d-46ea-b19a-cfe78e697626 req-00ff5f31-397e-459d-852b-5833916ab039 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:54.300046 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.compute.server_external_events [req-f4614a3d-8f8d-46ea-b19a-cfe78e697626 req-00ff5f31-397e-459d-852b-5833916ab039 service nova] Unable to find a host for instance 921553b2-7c2b-4ec6-80c9-23298af50994. Dropping event network-vif-unplugged {{(pid=121152) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 12:22:54.301422 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-f4614a3d-8f8d-46ea-b19a-cfe78e697626 req-00ff5f31-397e-459d-852b-5833916ab039 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.240873 Sep 14 12:22:54.302489 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 636/1266] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 243 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 12:22:54.647920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4faeca3b-e6c1-47ff-ac3f-004fea3593e0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:54.648782 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4faeca3b-e6c1-47ff-ac3f-004fea3593e0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:54.655835 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4faeca3b-e6c1-47ff-ac3f-004fea3593e0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:54.656466 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4faeca3b-e6c1-47ff-ac3f-004fea3593e0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:54.656954 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4faeca3b-e6c1-47ff-ac3f-004fea3593e0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:54.660067 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4faeca3b-e6c1-47ff-ac3f-004fea3593e0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:54.660067 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4faeca3b-e6c1-47ff-ac3f-004fea3593e0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:54.660067 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4faeca3b-e6c1-47ff-ac3f-004fea3593e0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:54.893974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4faeca3b-e6c1-47ff-ac3f-004fea3593e0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:54.904273 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4faeca3b-e6c1-47ff-ac3f-004fea3593e0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1516 microversion: 2.1 time: 0.260755 Sep 14 12:22:54.905034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 631/1267] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:54 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:55.934537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e54bd1e8-6eaa-4da9-b1e0-661ec31d9b2f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:55.936261 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e54bd1e8-6eaa-4da9-b1e0-661ec31d9b2f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:55.945938 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e54bd1e8-6eaa-4da9-b1e0-661ec31d9b2f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:55.947294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e54bd1e8-6eaa-4da9-b1e0-661ec31d9b2f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:55.948173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e54bd1e8-6eaa-4da9-b1e0-661ec31d9b2f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:55.949311 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e54bd1e8-6eaa-4da9-b1e0-661ec31d9b2f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:55.950185 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e54bd1e8-6eaa-4da9-b1e0-661ec31d9b2f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:55.951513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e54bd1e8-6eaa-4da9-b1e0-661ec31d9b2f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:56.159280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e54bd1e8-6eaa-4da9-b1e0-661ec31d9b2f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:56.168696 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e54bd1e8-6eaa-4da9-b1e0-661ec31d9b2f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1516 microversion: 2.1 time: 0.240813 Sep 14 12:22:56.170588 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 637/1268] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:55 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:22:57.200114 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-b231b5d0-0bc0-4123-8dec-ac27bebbf4bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:57.200831 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-b231b5d0-0bc0-4123-8dec-ac27bebbf4bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:57.218363 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b231b5d0-0bc0-4123-8dec-ac27bebbf4bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:57.219307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b231b5d0-0bc0-4123-8dec-ac27bebbf4bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:57.219966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b231b5d0-0bc0-4123-8dec-ac27bebbf4bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:57.221078 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b231b5d0-0bc0-4123-8dec-ac27bebbf4bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:57.225006 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b231b5d0-0bc0-4123-8dec-ac27bebbf4bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:57.225820 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-b231b5d0-0bc0-4123-8dec-ac27bebbf4bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:57.472829 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-b231b5d0-0bc0-4123-8dec-ac27bebbf4bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:57.474644 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-b231b5d0-0bc0-4123-8dec-ac27bebbf4bd tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1516 microversion: 2.1 time: 0.279161 Sep 14 12:22:57.475451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 632/1269] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:57 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1516 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:22:58.502274 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0ea34ad2-6740-44ea-a4a7-a11e0df7fa2e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:58.503714 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0ea34ad2-6740-44ea-a4a7-a11e0df7fa2e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:58.513654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ea34ad2-6740-44ea-a4a7-a11e0df7fa2e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:58.514560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ea34ad2-6740-44ea-a4a7-a11e0df7fa2e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:58.515221 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ea34ad2-6740-44ea-a4a7-a11e0df7fa2e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:58.516605 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ea34ad2-6740-44ea-a4a7-a11e0df7fa2e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:58.517402 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ea34ad2-6740-44ea-a4a7-a11e0df7fa2e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:58.518195 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ea34ad2-6740-44ea-a4a7-a11e0df7fa2e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:58.737403 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0ea34ad2-6740-44ea-a4a7-a11e0df7fa2e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:22:58.748657 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0ea34ad2-6740-44ea-a4a7-a11e0df7fa2e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1516 microversion: 2.1 time: 0.251540 Sep 14 12:22:58.753756 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 638/1270] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:58 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:22:59.776595 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d6263e91-8aa5-473a-9579-0221aa0ef694 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:22:59.781195 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d6263e91-8aa5-473a-9579-0221aa0ef694 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:22:59.784142 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=29 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:59.808118 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6263e91-8aa5-473a-9579-0221aa0ef694 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:59.815715 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6263e91-8aa5-473a-9579-0221aa0ef694 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:59.816998 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6263e91-8aa5-473a-9579-0221aa0ef694 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:59.827814 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6263e91-8aa5-473a-9579-0221aa0ef694 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:22:59.830270 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6263e91-8aa5-473a-9579-0221aa0ef694 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:22:59.831403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d6263e91-8aa5-473a-9579-0221aa0ef694 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:22:59.838634 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:00.095026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d6263e91-8aa5-473a-9579-0221aa0ef694 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:00.106034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d6263e91-8aa5-473a-9579-0221aa0ef694 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1518 microversion: 2.1 time: 0.336277 Sep 14 12:23:00.108106 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 633/1271] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:22:59 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1518 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:01.149617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a84f03c1-db11-4e90-b984-8d3b2c3d4b6d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:01.151521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a84f03c1-db11-4e90-b984-8d3b2c3d4b6d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:01.156727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:01.166144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a84f03c1-db11-4e90-b984-8d3b2c3d4b6d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:01.168440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a84f03c1-db11-4e90-b984-8d3b2c3d4b6d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:01.168711 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a84f03c1-db11-4e90-b984-8d3b2c3d4b6d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:01.169994 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a84f03c1-db11-4e90-b984-8d3b2c3d4b6d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:01.171477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a84f03c1-db11-4e90-b984-8d3b2c3d4b6d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:01.172631 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-a84f03c1-db11-4e90-b984-8d3b2c3d4b6d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:01.180882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:01.390496 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a84f03c1-db11-4e90-b984-8d3b2c3d4b6d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:01.408499 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a84f03c1-db11-4e90-b984-8d3b2c3d4b6d tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.267032 Sep 14 12:23:01.422926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 639/1272] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:01 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:02.436900 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f8720c0c-6a5b-4f6f-864f-0c37a5ee1dda tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:02.437897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f8720c0c-6a5b-4f6f-864f-0c37a5ee1dda tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:02.450950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-6a5b-4f6f-864f-0c37a5ee1dda tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:02.451663 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-6a5b-4f6f-864f-0c37a5ee1dda tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:02.452144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-6a5b-4f6f-864f-0c37a5ee1dda tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:02.452879 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-6a5b-4f6f-864f-0c37a5ee1dda tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:02.453338 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-6a5b-4f6f-864f-0c37a5ee1dda tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:02.453767 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-6a5b-4f6f-864f-0c37a5ee1dda tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:02.632698 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f8720c0c-6a5b-4f6f-864f-0c37a5ee1dda tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:02.641037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f8720c0c-6a5b-4f6f-864f-0c37a5ee1dda tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.208091 Sep 14 12:23:02.641627 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 634/1273] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:02 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:03.667652 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3e00379b-31d8-40b4-8573-bfc8b8506ac9 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:03.668354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3e00379b-31d8-40b4-8573-bfc8b8506ac9 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:03.675097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3e00379b-31d8-40b4-8573-bfc8b8506ac9 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:03.675577 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3e00379b-31d8-40b4-8573-bfc8b8506ac9 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:03.676042 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3e00379b-31d8-40b4-8573-bfc8b8506ac9 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:03.676738 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3e00379b-31d8-40b4-8573-bfc8b8506ac9 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:03.677188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3e00379b-31d8-40b4-8573-bfc8b8506ac9 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:03.677608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3e00379b-31d8-40b4-8573-bfc8b8506ac9 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:03.847108 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3e00379b-31d8-40b4-8573-bfc8b8506ac9 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:03.855702 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3e00379b-31d8-40b4-8573-bfc8b8506ac9 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.191918 Sep 14 12:23:03.856286 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 640/1274] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:03 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:04.880743 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1f056d79-63a9-4f80-8e3b-0db271b0edb5 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:04.882329 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1f056d79-63a9-4f80-8e3b-0db271b0edb5 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:04.890628 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f056d79-63a9-4f80-8e3b-0db271b0edb5 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:04.906467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f056d79-63a9-4f80-8e3b-0db271b0edb5 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:04.906467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f056d79-63a9-4f80-8e3b-0db271b0edb5 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:04.906467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f056d79-63a9-4f80-8e3b-0db271b0edb5 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:04.906467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f056d79-63a9-4f80-8e3b-0db271b0edb5 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:04.906891 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f056d79-63a9-4f80-8e3b-0db271b0edb5 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:05.056957 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1f056d79-63a9-4f80-8e3b-0db271b0edb5 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:05.067026 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1f056d79-63a9-4f80-8e3b-0db271b0edb5 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.190415 Sep 14 12:23:05.068171 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 635/1275] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:04 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:06.092643 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f0cc599b-2634-44de-bdff-bc91d14a95b8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:06.093477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f0cc599b-2634-44de-bdff-bc91d14a95b8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:06.108385 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0cc599b-2634-44de-bdff-bc91d14a95b8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:06.108882 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0cc599b-2634-44de-bdff-bc91d14a95b8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:06.109317 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0cc599b-2634-44de-bdff-bc91d14a95b8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:06.110210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0cc599b-2634-44de-bdff-bc91d14a95b8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:06.110667 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0cc599b-2634-44de-bdff-bc91d14a95b8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:06.111092 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f0cc599b-2634-44de-bdff-bc91d14a95b8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:06.289244 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f0cc599b-2634-44de-bdff-bc91d14a95b8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:06.298449 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f0cc599b-2634-44de-bdff-bc91d14a95b8 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.210256 Sep 14 12:23:06.313967 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 641/1276] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:06 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:07.324337 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ab032bd9-cf40-45fe-95f7-500b98a134b0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:07.326503 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ab032bd9-cf40-45fe-95f7-500b98a134b0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:07.333240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab032bd9-cf40-45fe-95f7-500b98a134b0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:07.333823 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab032bd9-cf40-45fe-95f7-500b98a134b0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:07.334352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab032bd9-cf40-45fe-95f7-500b98a134b0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:07.335416 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab032bd9-cf40-45fe-95f7-500b98a134b0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:07.335957 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab032bd9-cf40-45fe-95f7-500b98a134b0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:07.336455 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ab032bd9-cf40-45fe-95f7-500b98a134b0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:07.477669 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ab032bd9-cf40-45fe-95f7-500b98a134b0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:07.486003 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ab032bd9-cf40-45fe-95f7-500b98a134b0 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.165722 Sep 14 12:23:07.486837 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 636/1277] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:07 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:08.006595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c4105730-a185-4932-9274-13d84f1fa938 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Action: 'create', calling method: .version_select at 0x7f1c99a8ac10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2027457668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWJZxPkCKywrtb3P1yqF+mI5T7rbOTiDPEmhaeYygFJLPCl7M8Q9pApqLqJvF7Jn2bURwAf5WPFD+BmwtgXzmf3KyFQK109vPYLoePIXEPo9b7UNMOd48yxVHoqjLU3uw=="}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:08.023695 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-c4105730-a185-4932-9274-13d84f1fa938 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Getting quotas for project b9a967a1f3444a1e8b7f4321722b5949. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:23:08.028078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-c4105730-a185-4932-9274-13d84f1fa938 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Getting quotas for user 6e9703bf61d14dc4ac52a7c50fb8390e and project b9a967a1f3444a1e8b7f4321722b5949. Resources: {'key_pairs'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:23:08.104687 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c4105730-a185-4932-9274-13d84f1fa938 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.101963 Sep 14 12:23:08.105305 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 642/1278] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Sep 14 12:23:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:23:08.156913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-610432797", "imageRef": "146ee212-0de6-44b9-a8b3-b82aa85b0e3c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2027457668", "networks": [{"uuid": "6856505e-81d6-410f-8a50-79da18a2fea9"}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:08.214957 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] validate_networks() for [('6856505e-81d6-410f-8a50-79da18a2fea9', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:23:08.512293 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ec3474e5-99ef-4e99-a462-cc7e6c36f939 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:08.512807 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ec3474e5-99ef-4e99-a462-cc7e6c36f939 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:08.519884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec3474e5-99ef-4e99-a462-cc7e6c36f939 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:08.520380 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec3474e5-99ef-4e99-a462-cc7e6c36f939 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:08.520820 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec3474e5-99ef-4e99-a462-cc7e6c36f939 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:08.521527 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec3474e5-99ef-4e99-a462-cc7e6c36f939 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:08.522011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec3474e5-99ef-4e99-a462-cc7e6c36f939 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:08.522444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ec3474e5-99ef-4e99-a462-cc7e6c36f939 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:08.694835 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:23:08.695407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:23:08.695893 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:23:08.696300 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:23:08.696717 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:23:08.709285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:08.709285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:08.709285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:08.709285 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:08.709783 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:08.709783 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:08.721908 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ec3474e5-99ef-4e99-a462-cc7e6c36f939 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:08.728629 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Getting quotas for project b9a967a1f3444a1e8b7f4321722b5949. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:23:08.730791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ec3474e5-99ef-4e99-a462-cc7e6c36f939 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.222924 Sep 14 12:23:08.731397 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 643/1279] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:08 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:08.733824 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Getting quotas for user 6e9703bf61d14dc4ac52a7c50fb8390e and project b9a967a1f3444a1e8b7f4321722b5949. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:23:08.746565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:23:08.748852 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='146ee212-0de6-44b9-a8b3-b82aa85b0e3c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:23:08.876694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4779a4b0-7753-4d3e-9da7-0909ae4f81c0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723876 Sep 14 12:23:08.877380 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 637/1280] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:23:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:23:08.888309 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8694ed32-1bea-4aff-b0ea-f18cad7f4a9a tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:08.891313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8694ed32-1bea-4aff-b0ea-f18cad7f4a9a tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:08.945008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8694ed32-1bea-4aff-b0ea-f18cad7f4a9a tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:08.952589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8694ed32-1bea-4aff-b0ea-f18cad7f4a9a tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1258 microversion: 2.1 time: 0.068075 Sep 14 12:23:08.953591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 644/1281] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:08 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:09.762364 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-09a1910b-a071-4112-a8df-41119eb4db3c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:09.762364 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-09a1910b-a071-4112-a8df-41119eb4db3c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:09.763282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a1910b-a071-4112-a8df-41119eb4db3c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:09.763794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a1910b-a071-4112-a8df-41119eb4db3c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:09.764279 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a1910b-a071-4112-a8df-41119eb4db3c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:09.764993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a1910b-a071-4112-a8df-41119eb4db3c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:09.765377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a1910b-a071-4112-a8df-41119eb4db3c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:09.765809 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-09a1910b-a071-4112-a8df-41119eb4db3c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:09.917437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-09a1910b-a071-4112-a8df-41119eb4db3c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:09.925573 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-09a1910b-a071-4112-a8df-41119eb4db3c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.174938 Sep 14 12:23:09.926216 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 638/1282] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:09 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:09.976508 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5185c326-4c99-4a84-b7d9-be0545274d5d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:09.977270 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5185c326-4c99-4a84-b7d9-be0545274d5d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:10.045901 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5185c326-4c99-4a84-b7d9-be0545274d5d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:10.053212 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5185c326-4c99-4a84-b7d9-be0545274d5d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1258 microversion: 2.1 time: 0.080678 Sep 14 12:23:10.053986 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 645/1283] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:09 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:10.948734 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6decf394-1ed2-4ea6-a75a-800151148809 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:10.949356 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6decf394-1ed2-4ea6-a75a-800151148809 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:11.033404 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6decf394-1ed2-4ea6-a75a-800151148809 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:11.033918 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6decf394-1ed2-4ea6-a75a-800151148809 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:11.034358 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6decf394-1ed2-4ea6-a75a-800151148809 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:11.035097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6decf394-1ed2-4ea6-a75a-800151148809 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:11.035547 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6decf394-1ed2-4ea6-a75a-800151148809 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:11.035970 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6decf394-1ed2-4ea6-a75a-800151148809 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:11.086071 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-471eb440-1965-4464-86d7-4523a5c22760 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:11.086772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-471eb440-1965-4464-86d7-4523a5c22760 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:11.093705 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-471eb440-1965-4464-86d7-4523a5c22760 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:11.094243 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-471eb440-1965-4464-86d7-4523a5c22760 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:11.094851 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-471eb440-1965-4464-86d7-4523a5c22760 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:11.095381 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-471eb440-1965-4464-86d7-4523a5c22760 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:11.096354 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-471eb440-1965-4464-86d7-4523a5c22760 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:11.096512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-471eb440-1965-4464-86d7-4523a5c22760 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:11.182196 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-471eb440-1965-4464-86d7-4523a5c22760 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:11.191372 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-471eb440-1965-4464-86d7-4523a5c22760 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1310 microversion: 2.1 time: 0.109129 Sep 14 12:23:11.191969 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 646/1284] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:11 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:11.214974 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6decf394-1ed2-4ea6-a75a-800151148809 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:11.224435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6decf394-1ed2-4ea6-a75a-800151148809 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.279699 Sep 14 12:23:11.225047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 639/1285] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:10 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:12.215127 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-beb95027-f52e-47b4-87b2-f1cdd833b340 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:12.215873 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-beb95027-f52e-47b4-87b2-f1cdd833b340 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:12.222920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-beb95027-f52e-47b4-87b2-f1cdd833b340 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:12.223409 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-beb95027-f52e-47b4-87b2-f1cdd833b340 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:12.223843 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-beb95027-f52e-47b4-87b2-f1cdd833b340 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:12.224556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-beb95027-f52e-47b4-87b2-f1cdd833b340 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:12.225002 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-beb95027-f52e-47b4-87b2-f1cdd833b340 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:12.225421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-beb95027-f52e-47b4-87b2-f1cdd833b340 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:12.253924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-97532b13-5767-4861-8e4a-e6fbaa43471f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:12.253924 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-97532b13-5767-4861-8e4a-e6fbaa43471f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:12.267731 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97532b13-5767-4861-8e4a-e6fbaa43471f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:12.268230 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97532b13-5767-4861-8e4a-e6fbaa43471f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:12.268984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97532b13-5767-4861-8e4a-e6fbaa43471f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:12.269705 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97532b13-5767-4861-8e4a-e6fbaa43471f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:12.270185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97532b13-5767-4861-8e4a-e6fbaa43471f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:12.270609 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-97532b13-5767-4861-8e4a-e6fbaa43471f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:12.488124 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-beb95027-f52e-47b4-87b2-f1cdd833b340 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:12.503210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-beb95027-f52e-47b4-87b2-f1cdd833b340 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1316 microversion: 2.1 time: 0.291997 Sep 14 12:23:12.503816 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 647/1286] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:12 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:12.680375 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-97532b13-5767-4861-8e4a-e6fbaa43471f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:12.688519 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-97532b13-5767-4861-8e4a-e6fbaa43471f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.441027 Sep 14 12:23:12.689111 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 640/1287] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:12 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:13.534620 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-85dc1686-18cd-49dc-b70a-5b5b48bb26ca tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:13.536812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-85dc1686-18cd-49dc-b70a-5b5b48bb26ca tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:13.545549 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85dc1686-18cd-49dc-b70a-5b5b48bb26ca tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:13.546275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85dc1686-18cd-49dc-b70a-5b5b48bb26ca tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:13.546917 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85dc1686-18cd-49dc-b70a-5b5b48bb26ca tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:13.547781 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85dc1686-18cd-49dc-b70a-5b5b48bb26ca tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:13.548423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85dc1686-18cd-49dc-b70a-5b5b48bb26ca tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:13.548830 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85dc1686-18cd-49dc-b70a-5b5b48bb26ca tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:13.714120 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-99b27e7b-7383-406c-993a-8c6777e7824e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:13.714848 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-99b27e7b-7383-406c-993a-8c6777e7824e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:13.727563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99b27e7b-7383-406c-993a-8c6777e7824e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:13.732187 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99b27e7b-7383-406c-993a-8c6777e7824e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:13.732751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99b27e7b-7383-406c-993a-8c6777e7824e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:13.733524 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99b27e7b-7383-406c-993a-8c6777e7824e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:13.734051 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99b27e7b-7383-406c-993a-8c6777e7824e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:13.734486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99b27e7b-7383-406c-993a-8c6777e7824e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:13.757622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-85dc1686-18cd-49dc-b70a-5b5b48bb26ca tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:13.767752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-85dc1686-18cd-49dc-b70a-5b5b48bb26ca tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.241416 Sep 14 12:23:13.768715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 648/1288] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:13 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:13.915414 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-99b27e7b-7383-406c-993a-8c6777e7824e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:13.925904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-99b27e7b-7383-406c-993a-8c6777e7824e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.216380 Sep 14 12:23:13.926499 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 641/1289] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:13 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:14.491050 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-8a63d98a-7f04-428c-b05e-36858e151129 req-7542b194-6835-481c-8dc6-4483f84b56f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921553b2-7c2b-4ec6-80c9-23298af50994", "name": "network-vif-plugged", "status": "completed", "tag": "f37c6abe-5567-400c-b0bd-04c3772b1a60"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:14.511682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-8a63d98a-7f04-428c-b05e-36858e151129 req-7542b194-6835-481c-8dc6-4483f84b56f0 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:14.511682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-8a63d98a-7f04-428c-b05e-36858e151129 req-7542b194-6835-481c-8dc6-4483f84b56f0 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:14.511682 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-8a63d98a-7f04-428c-b05e-36858e151129 req-7542b194-6835-481c-8dc6-4483f84b56f0 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:14.516135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-8a63d98a-7f04-428c-b05e-36858e151129 req-7542b194-6835-481c-8dc6-4483f84b56f0 service nova] Creating event network-vif-plugged:f37c6abe-5567-400c-b0bd-04c3772b1a60 for instance 921553b2-7c2b-4ec6-80c9-23298af50994 on hv-cinder-84496 Sep 14 12:23:14.521641 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-8a63d98a-7f04-428c-b05e-36858e151129 req-7542b194-6835-481c-8dc6-4483f84b56f0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036139 Sep 14 12:23:14.522282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 649/1290] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:23:14.793100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3a6a4ad9-3e83-42b7-9e71-5197313db613 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:14.795792 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3a6a4ad9-3e83-42b7-9e71-5197313db613 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:14.803426 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a6a4ad9-3e83-42b7-9e71-5197313db613 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:14.803984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a6a4ad9-3e83-42b7-9e71-5197313db613 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:14.804422 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a6a4ad9-3e83-42b7-9e71-5197313db613 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:14.805375 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a6a4ad9-3e83-42b7-9e71-5197313db613 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:14.806021 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a6a4ad9-3e83-42b7-9e71-5197313db613 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:14.806606 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3a6a4ad9-3e83-42b7-9e71-5197313db613 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:14.951536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e6ce779d-b7b9-4482-9649-b75fad47e73f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:14.952586 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e6ce779d-b7b9-4482-9649-b75fad47e73f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:14.959750 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e6ce779d-b7b9-4482-9649-b75fad47e73f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:14.960389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e6ce779d-b7b9-4482-9649-b75fad47e73f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:14.966785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e6ce779d-b7b9-4482-9649-b75fad47e73f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:14.970160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e6ce779d-b7b9-4482-9649-b75fad47e73f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:14.970869 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e6ce779d-b7b9-4482-9649-b75fad47e73f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:14.971535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e6ce779d-b7b9-4482-9649-b75fad47e73f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:14.971668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3a6a4ad9-3e83-42b7-9e71-5197313db613 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:14.983492 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3a6a4ad9-3e83-42b7-9e71-5197313db613 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.195376 Sep 14 12:23:14.984130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 642/1291] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:14 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:15.121553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e6ce779d-b7b9-4482-9649-b75fad47e73f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:15.131992 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e6ce779d-b7b9-4482-9649-b75fad47e73f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.185270 Sep 14 12:23:15.132664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 650/1292] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:14 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:16.011297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-6490413f-4431-4f7f-b7e9-099236f27eb5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:16.011976 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-6490413f-4431-4f7f-b7e9-099236f27eb5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:16.020808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6490413f-4431-4f7f-b7e9-099236f27eb5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:16.021292 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6490413f-4431-4f7f-b7e9-099236f27eb5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:16.021724 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6490413f-4431-4f7f-b7e9-099236f27eb5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:16.022448 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6490413f-4431-4f7f-b7e9-099236f27eb5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:16.022901 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6490413f-4431-4f7f-b7e9-099236f27eb5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:16.023321 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-6490413f-4431-4f7f-b7e9-099236f27eb5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:16.156699 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-02eac8d0-1cc2-4bf5-9f80-5f50c5477cc6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:16.157359 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-02eac8d0-1cc2-4bf5-9f80-5f50c5477cc6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:16.164073 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02eac8d0-1cc2-4bf5-9f80-5f50c5477cc6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:16.164572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02eac8d0-1cc2-4bf5-9f80-5f50c5477cc6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:16.165170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02eac8d0-1cc2-4bf5-9f80-5f50c5477cc6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:16.165978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02eac8d0-1cc2-4bf5-9f80-5f50c5477cc6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:16.166442 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02eac8d0-1cc2-4bf5-9f80-5f50c5477cc6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:16.166871 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-02eac8d0-1cc2-4bf5-9f80-5f50c5477cc6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:16.171904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-6490413f-4431-4f7f-b7e9-099236f27eb5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:16.180788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-6490413f-4431-4f7f-b7e9-099236f27eb5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.175651 Sep 14 12:23:16.181382 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 643/1293] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:16 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:16.339090 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-16d9dd30-e8d9-4822-96f8-279905d970c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:16.340689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-02eac8d0-1cc2-4bf5-9f80-5f50c5477cc6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:16.342716 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-16d9dd30-e8d9-4822-96f8-279905d970c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:16.349052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16d9dd30-e8d9-4822-96f8-279905d970c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:16.349821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16d9dd30-e8d9-4822-96f8-279905d970c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:16.349998 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-02eac8d0-1cc2-4bf5-9f80-5f50c5477cc6 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.197649 Sep 14 12:23:16.350284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16d9dd30-e8d9-4822-96f8-279905d970c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:16.350811 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 651/1294] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:16 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:16.351116 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16d9dd30-e8d9-4822-96f8-279905d970c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:16.351645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16d9dd30-e8d9-4822-96f8-279905d970c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:16.352072 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-16d9dd30-e8d9-4822-96f8-279905d970c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:16.388196 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-16d9dd30-e8d9-4822-96f8-279905d970c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:23:17.204279 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-25389c38-bbf0-4f71-80e7-1b486039f20e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:17.204974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-25389c38-bbf0-4f71-80e7-1b486039f20e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:17.211443 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25389c38-bbf0-4f71-80e7-1b486039f20e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:17.212874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25389c38-bbf0-4f71-80e7-1b486039f20e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:17.212874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25389c38-bbf0-4f71-80e7-1b486039f20e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:17.213110 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25389c38-bbf0-4f71-80e7-1b486039f20e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:17.213492 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25389c38-bbf0-4f71-80e7-1b486039f20e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:17.213962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-25389c38-bbf0-4f71-80e7-1b486039f20e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:17.276806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-16d9dd30-e8d9-4822-96f8-279905d970c2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "DELETE /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 204 len: 0 microversion: 2.1 time: 0.942966 Sep 14 12:23:17.285139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 644/1295] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:23:16 2022] DELETE /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:23:17.300619 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f6b66a86-c4b9-4958-881c-f98c2095d8bb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:17.302573 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f6b66a86-c4b9-4958-881c-f98c2095d8bb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:17.316294 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6b66a86-c4b9-4958-881c-f98c2095d8bb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:17.317801 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6b66a86-c4b9-4958-881c-f98c2095d8bb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:17.318692 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6b66a86-c4b9-4958-881c-f98c2095d8bb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:17.319925 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6b66a86-c4b9-4958-881c-f98c2095d8bb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:17.320745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6b66a86-c4b9-4958-881c-f98c2095d8bb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:17.321502 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f6b66a86-c4b9-4958-881c-f98c2095d8bb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:17.425278 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-25389c38-bbf0-4f71-80e7-1b486039f20e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:17.435130 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-25389c38-bbf0-4f71-80e7-1b486039f20e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.234314 Sep 14 12:23:17.436441 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 652/1296] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:17 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:17.441971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-af7e5e49-f391-43fc-af7d-a9cf19262284 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:17.443648 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-af7e5e49-f391-43fc-af7d-a9cf19262284 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:17.451288 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e5e49-f391-43fc-af7d-a9cf19262284 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:17.452179 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e5e49-f391-43fc-af7d-a9cf19262284 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:17.453022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e5e49-f391-43fc-af7d-a9cf19262284 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:17.454459 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e5e49-f391-43fc-af7d-a9cf19262284 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:17.455249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e5e49-f391-43fc-af7d-a9cf19262284 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:17.456011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-af7e5e49-f391-43fc-af7d-a9cf19262284 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:17.616946 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f6b66a86-c4b9-4958-881c-f98c2095d8bb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:17.628571 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f6b66a86-c4b9-4958-881c-f98c2095d8bb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1578 microversion: 2.1 time: 0.340962 Sep 14 12:23:17.629190 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 645/1297] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:17 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1578 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:17.694404 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-af7e5e49-f391-43fc-af7d-a9cf19262284 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:17.703513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-af7e5e49-f391-43fc-af7d-a9cf19262284 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.265245 Sep 14 12:23:17.704094 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 653/1298] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:17 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:18.464181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bd730183-e968-4f2d-813d-60714154fcb1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:18.466477 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bd730183-e968-4f2d-813d-60714154fcb1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:18.473517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd730183-e968-4f2d-813d-60714154fcb1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:18.474440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd730183-e968-4f2d-813d-60714154fcb1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:18.475139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd730183-e968-4f2d-813d-60714154fcb1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:18.476127 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd730183-e968-4f2d-813d-60714154fcb1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:18.476805 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd730183-e968-4f2d-813d-60714154fcb1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:18.477470 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bd730183-e968-4f2d-813d-60714154fcb1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:18.649009 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bd730183-e968-4f2d-813d-60714154fcb1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:18.658043 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6dde982c-5454-4240-b45f-ce7bf9579ae7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:18.659132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6dde982c-5454-4240-b45f-ce7bf9579ae7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:18.671390 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bd730183-e968-4f2d-813d-60714154fcb1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.211321 Sep 14 12:23:18.686275 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 646/1299] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:18 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:18.689038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dde982c-5454-4240-b45f-ce7bf9579ae7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:18.689755 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dde982c-5454-4240-b45f-ce7bf9579ae7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:18.690385 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dde982c-5454-4240-b45f-ce7bf9579ae7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:18.691405 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dde982c-5454-4240-b45f-ce7bf9579ae7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:18.692055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dde982c-5454-4240-b45f-ce7bf9579ae7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:18.692972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6dde982c-5454-4240-b45f-ce7bf9579ae7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:18.728858 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8a71ff32-04e9-4252-ae34-6d7a2835660c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:18.729559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8a71ff32-04e9-4252-ae34-6d7a2835660c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:18.732328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:18.737720 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a71ff32-04e9-4252-ae34-6d7a2835660c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:18.738781 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a71ff32-04e9-4252-ae34-6d7a2835660c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:18.739335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a71ff32-04e9-4252-ae34-6d7a2835660c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:18.740264 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a71ff32-04e9-4252-ae34-6d7a2835660c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:18.740738 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a71ff32-04e9-4252-ae34-6d7a2835660c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:18.741165 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8a71ff32-04e9-4252-ae34-6d7a2835660c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:18.741822 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=6 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:18.955986 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6dde982c-5454-4240-b45f-ce7bf9579ae7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:18.969031 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6dde982c-5454-4240-b45f-ce7bf9579ae7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1578 microversion: 2.1 time: 0.317567 Sep 14 12:23:18.970432 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 654/1300] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:18 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1578 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:18.996565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8a71ff32-04e9-4252-ae34-6d7a2835660c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:19.016991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8a71ff32-04e9-4252-ae34-6d7a2835660c tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.292187 Sep 14 12:23:19.019099 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 647/1301] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:18 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:19.696086 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-47c78689-b345-471e-906b-ee7965cb26b9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:19.696780 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-47c78689-b345-471e-906b-ee7965cb26b9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:19.704443 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47c78689-b345-471e-906b-ee7965cb26b9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:19.704943 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47c78689-b345-471e-906b-ee7965cb26b9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:19.705384 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47c78689-b345-471e-906b-ee7965cb26b9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:19.706135 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47c78689-b345-471e-906b-ee7965cb26b9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:19.706611 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47c78689-b345-471e-906b-ee7965cb26b9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:19.707045 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-47c78689-b345-471e-906b-ee7965cb26b9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:19.867241 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-47c78689-b345-471e-906b-ee7965cb26b9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:19.875418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-47c78689-b345-471e-906b-ee7965cb26b9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.183595 Sep 14 12:23:19.876317 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 655/1302] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:19 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:19.997635 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-99a70cb5-36c4-4dcc-9e42-8003b3a44d14 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:19.998320 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-99a70cb5-36c4-4dcc-9e42-8003b3a44d14 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:20.005010 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99a70cb5-36c4-4dcc-9e42-8003b3a44d14 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:20.005504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99a70cb5-36c4-4dcc-9e42-8003b3a44d14 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:20.005967 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99a70cb5-36c4-4dcc-9e42-8003b3a44d14 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:20.006928 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99a70cb5-36c4-4dcc-9e42-8003b3a44d14 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:20.007388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99a70cb5-36c4-4dcc-9e42-8003b3a44d14 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:20.007812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-99a70cb5-36c4-4dcc-9e42-8003b3a44d14 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:20.049178 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-499630da-eab5-4ada-bcc4-df958c963a63 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:20.049954 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-499630da-eab5-4ada-bcc4-df958c963a63 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:20.052048 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=8 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:20.057157 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-499630da-eab5-4ada-bcc4-df958c963a63 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:20.057967 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-499630da-eab5-4ada-bcc4-df958c963a63 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:20.058713 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-499630da-eab5-4ada-bcc4-df958c963a63 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:20.060200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-499630da-eab5-4ada-bcc4-df958c963a63 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:20.060677 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-499630da-eab5-4ada-bcc4-df958c963a63 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:20.061100 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-499630da-eab5-4ada-bcc4-df958c963a63 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:20.222444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-99a70cb5-36c4-4dcc-9e42-8003b3a44d14 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:20.225012 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:20.235087 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-99a70cb5-36c4-4dcc-9e42-8003b3a44d14 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1578 microversion: 2.1 time: 0.243967 Sep 14 12:23:20.237401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 648/1303] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:19 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1578 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:20.254729 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-499630da-eab5-4ada-bcc4-df958c963a63 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:20.264972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-499630da-eab5-4ada-bcc4-df958c963a63 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.219488 Sep 14 12:23:20.265778 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 656/1304] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:20 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:20.913452 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-31af3441-947b-46e9-b1f0-a9357b72d26c tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:20.914135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-31af3441-947b-46e9-b1f0-a9357b72d26c tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:20.921565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31af3441-947b-46e9-b1f0-a9357b72d26c tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:20.922098 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31af3441-947b-46e9-b1f0-a9357b72d26c tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:20.922546 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31af3441-947b-46e9-b1f0-a9357b72d26c tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:20.923305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31af3441-947b-46e9-b1f0-a9357b72d26c tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:20.923762 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31af3441-947b-46e9-b1f0-a9357b72d26c tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:20.924192 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-31af3441-947b-46e9-b1f0-a9357b72d26c tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:21.054050 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-31af3441-947b-46e9-b1f0-a9357b72d26c tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:21.061888 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-31af3441-947b-46e9-b1f0-a9357b72d26c tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.152483 Sep 14 12:23:21.062469 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 649/1305] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:20 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:21.260160 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-05a28fbb-1509-48aa-a058-99704accf7f1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:21.260770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-05a28fbb-1509-48aa-a058-99704accf7f1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:21.267896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05a28fbb-1509-48aa-a058-99704accf7f1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:21.268632 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05a28fbb-1509-48aa-a058-99704accf7f1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:21.269065 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05a28fbb-1509-48aa-a058-99704accf7f1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:21.269759 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05a28fbb-1509-48aa-a058-99704accf7f1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:21.270238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05a28fbb-1509-48aa-a058-99704accf7f1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:21.270663 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-05a28fbb-1509-48aa-a058-99704accf7f1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:21.297019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-13230b05-dc4c-47f4-9537-92a575745a5e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:21.297726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-13230b05-dc4c-47f4-9537-92a575745a5e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:21.303935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13230b05-dc4c-47f4-9537-92a575745a5e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:21.304502 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13230b05-dc4c-47f4-9537-92a575745a5e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:21.304943 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13230b05-dc4c-47f4-9537-92a575745a5e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:21.305903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13230b05-dc4c-47f4-9537-92a575745a5e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:21.306142 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13230b05-dc4c-47f4-9537-92a575745a5e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:21.306573 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-13230b05-dc4c-47f4-9537-92a575745a5e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:21.461273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-05a28fbb-1509-48aa-a058-99704accf7f1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:21.469518 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-05a28fbb-1509-48aa-a058-99704accf7f1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1578 microversion: 2.1 time: 0.213410 Sep 14 12:23:21.470134 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 657/1306] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:21 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1578 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:21.489966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-13230b05-dc4c-47f4-9537-92a575745a5e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:21.498249 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-13230b05-dc4c-47f4-9537-92a575745a5e tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.205507 Sep 14 12:23:21.498812 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 650/1307] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:21 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:22.085964 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9d4a2402-33b7-46d1-bc5b-d2f56e118095 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:22.086555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9d4a2402-33b7-46d1-bc5b-d2f56e118095 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:22.093304 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d4a2402-33b7-46d1-bc5b-d2f56e118095 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:22.095567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d4a2402-33b7-46d1-bc5b-d2f56e118095 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:22.095567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d4a2402-33b7-46d1-bc5b-d2f56e118095 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:22.095567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d4a2402-33b7-46d1-bc5b-d2f56e118095 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:22.095567 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d4a2402-33b7-46d1-bc5b-d2f56e118095 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:22.095971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9d4a2402-33b7-46d1-bc5b-d2f56e118095 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:22.228439 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9d4a2402-33b7-46d1-bc5b-d2f56e118095 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:22.237111 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9d4a2402-33b7-46d1-bc5b-d2f56e118095 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.155171 Sep 14 12:23:22.237661 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 658/1308] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:22 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:22.492640 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-12bb5195-f63b-4369-ba96-6fefd1456eb4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:22.493247 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-12bb5195-f63b-4369-ba96-6fefd1456eb4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:22.499227 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-12bb5195-f63b-4369-ba96-6fefd1456eb4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:22.499710 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-12bb5195-f63b-4369-ba96-6fefd1456eb4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:22.500146 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-12bb5195-f63b-4369-ba96-6fefd1456eb4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:22.500841 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-12bb5195-f63b-4369-ba96-6fefd1456eb4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:22.501288 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-12bb5195-f63b-4369-ba96-6fefd1456eb4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:22.501711 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-12bb5195-f63b-4369-ba96-6fefd1456eb4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:22.522598 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ac6847ea-5ff6-4b7b-be15-938486980b65 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:22.523258 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ac6847ea-5ff6-4b7b-be15-938486980b65 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:22.530512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac6847ea-5ff6-4b7b-be15-938486980b65 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:22.531007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac6847ea-5ff6-4b7b-be15-938486980b65 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:22.531442 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac6847ea-5ff6-4b7b-be15-938486980b65 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:22.532142 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac6847ea-5ff6-4b7b-be15-938486980b65 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:22.532595 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac6847ea-5ff6-4b7b-be15-938486980b65 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:22.533017 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ac6847ea-5ff6-4b7b-be15-938486980b65 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:22.551512 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:22.706592 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-12bb5195-f63b-4369-ba96-6fefd1456eb4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:22.715332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-12bb5195-f63b-4369-ba96-6fefd1456eb4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1578 microversion: 2.1 time: 0.226649 Sep 14 12:23:22.719232 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 651/1309] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:22 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:22.720198 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ac6847ea-5ff6-4b7b-be15-938486980b65 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:22.728054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ac6847ea-5ff6-4b7b-be15-938486980b65 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.209611 Sep 14 12:23:22.728618 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 659/1310] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:22 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:23.262912 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-c8248fb2-a2fb-4e35-8f8c-615c10925012 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:23.263687 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-c8248fb2-a2fb-4e35-8f8c-615c10925012 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:23.270733 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8248fb2-a2fb-4e35-8f8c-615c10925012 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:23.273745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8248fb2-a2fb-4e35-8f8c-615c10925012 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:23.273745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8248fb2-a2fb-4e35-8f8c-615c10925012 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:23.273745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8248fb2-a2fb-4e35-8f8c-615c10925012 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:23.273745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8248fb2-a2fb-4e35-8f8c-615c10925012 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:23.274212 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-c8248fb2-a2fb-4e35-8f8c-615c10925012 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:23.519667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-c8248fb2-a2fb-4e35-8f8c-615c10925012 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:23.527652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-c8248fb2-a2fb-4e35-8f8c-615c10925012 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.271302 Sep 14 12:23:23.528303 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 652/1311] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:23 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:23.738893 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-fd423109-f7a7-4c15-953e-230cbec2aff8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:23.739517 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-fd423109-f7a7-4c15-953e-230cbec2aff8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:23.746263 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fd423109-f7a7-4c15-953e-230cbec2aff8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:23.746873 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fd423109-f7a7-4c15-953e-230cbec2aff8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:23.747320 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fd423109-f7a7-4c15-953e-230cbec2aff8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:23.748022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fd423109-f7a7-4c15-953e-230cbec2aff8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:23.748480 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fd423109-f7a7-4c15-953e-230cbec2aff8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:23.748936 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-fd423109-f7a7-4c15-953e-230cbec2aff8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:23.751836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-68313ffd-6ac4-4ba8-bf2d-2abd081f2bf1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:23.752413 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-68313ffd-6ac4-4ba8-bf2d-2abd081f2bf1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:23.758582 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68313ffd-6ac4-4ba8-bf2d-2abd081f2bf1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:23.762979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68313ffd-6ac4-4ba8-bf2d-2abd081f2bf1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:23.762979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68313ffd-6ac4-4ba8-bf2d-2abd081f2bf1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:23.762979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68313ffd-6ac4-4ba8-bf2d-2abd081f2bf1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:23.762979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68313ffd-6ac4-4ba8-bf2d-2abd081f2bf1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:23.763359 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-68313ffd-6ac4-4ba8-bf2d-2abd081f2bf1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:24.072340 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-fd423109-f7a7-4c15-953e-230cbec2aff8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:24.081068 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-fd423109-f7a7-4c15-953e-230cbec2aff8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1578 microversion: 2.1 time: 0.346620 Sep 14 12:23:24.081813 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 660/1312] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:23 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1578 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:24.098836 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-68313ffd-6ac4-4ba8-bf2d-2abd081f2bf1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:24.106906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-68313ffd-6ac4-4ba8-bf2d-2abd081f2bf1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.358903 Sep 14 12:23:24.107485 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 653/1313] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:23 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:24.445931 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-1b7397f6-f12d-408a-ba82-6d5dd840b8cb req-7b7f3dfc-3ae6-44d4-b8ca-35f15f82e706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317a118f-cac5-4462-9a96-2292223af807", "tag": "d0116994-2eb1-4246-a0d6-2ce571474c5c"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:24.455957 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-1b7397f6-f12d-408a-ba82-6d5dd840b8cb req-7b7f3dfc-3ae6-44d4-b8ca-35f15f82e706 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:24.456437 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-1b7397f6-f12d-408a-ba82-6d5dd840b8cb req-7b7f3dfc-3ae6-44d4-b8ca-35f15f82e706 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:24.456870 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-1b7397f6-f12d-408a-ba82-6d5dd840b8cb req-7b7f3dfc-3ae6-44d4-b8ca-35f15f82e706 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:24.467496 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-1b7397f6-f12d-408a-ba82-6d5dd840b8cb req-7b7f3dfc-3ae6-44d4-b8ca-35f15f82e706 service nova] Creating event network-changed:d0116994-2eb1-4246-a0d6-2ce571474c5c for instance 317a118f-cac5-4462-9a96-2292223af807 on hv-cinder-84496 Sep 14 12:23:24.472380 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-1b7397f6-f12d-408a-ba82-6d5dd840b8cb req-7b7f3dfc-3ae6-44d4-b8ca-35f15f82e706 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129233 Sep 14 12:23:24.472962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 661/1314] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:23:24.551044 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-588e8b19-20eb-4d43-b7bb-a88dc781edfd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:24.551751 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-588e8b19-20eb-4d43-b7bb-a88dc781edfd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:24.558614 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-588e8b19-20eb-4d43-b7bb-a88dc781edfd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:24.559662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-588e8b19-20eb-4d43-b7bb-a88dc781edfd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:24.560056 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-588e8b19-20eb-4d43-b7bb-a88dc781edfd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:24.560794 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-588e8b19-20eb-4d43-b7bb-a88dc781edfd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:24.561256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-588e8b19-20eb-4d43-b7bb-a88dc781edfd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:24.561683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-588e8b19-20eb-4d43-b7bb-a88dc781edfd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:24.712115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-588e8b19-20eb-4d43-b7bb-a88dc781edfd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:24.720966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-588e8b19-20eb-4d43-b7bb-a88dc781edfd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.173876 Sep 14 12:23:24.721537 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 654/1315] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:24 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:25.107391 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-50c88f89-fced-4785-b819-c952b387ed71 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:25.108233 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-50c88f89-fced-4785-b819-c952b387ed71 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:25.114803 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50c88f89-fced-4785-b819-c952b387ed71 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:25.115403 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50c88f89-fced-4785-b819-c952b387ed71 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:25.116068 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50c88f89-fced-4785-b819-c952b387ed71 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:25.116777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50c88f89-fced-4785-b819-c952b387ed71 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:25.117236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50c88f89-fced-4785-b819-c952b387ed71 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:25.117672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-50c88f89-fced-4785-b819-c952b387ed71 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:25.129745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-0983b2d1-4f37-4d71-932b-5960943ff0e2 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:25.130991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-0983b2d1-4f37-4d71-932b-5960943ff0e2 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:25.135968 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 12:23:25.136167 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Wed Sep 14 12:23:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 (ip 10.222.0.62) !!! Sep 14 12:23:25.144153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0983b2d1-4f37-4d71-932b-5960943ff0e2 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:25.144656 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0983b2d1-4f37-4d71-932b-5960943ff0e2 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:25.145097 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0983b2d1-4f37-4d71-932b-5960943ff0e2 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:25.145808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0983b2d1-4f37-4d71-932b-5960943ff0e2 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:25.147053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0983b2d1-4f37-4d71-932b-5960943ff0e2 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:25.147486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-0983b2d1-4f37-4d71-932b-5960943ff0e2 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:25.440471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-50c88f89-fced-4785-b819-c952b387ed71 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:25.448563 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-50c88f89-fced-4785-b819-c952b387ed71 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1578 microversion: 2.1 time: 0.346476 Sep 14 12:23:25.449538 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 662/1316] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:25 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1578 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:25.464477 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-0983b2d1-4f37-4d71-932b-5960943ff0e2 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:25.472746 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-0983b2d1-4f37-4d71-932b-5960943ff0e2 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.347114 Sep 14 12:23:25.473331 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 655/1317] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:25 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:25.743296 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-71f5f07c-ec39-4a04-ae94-9cbb7142e0c6 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:25.743908 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-71f5f07c-ec39-4a04-ae94-9cbb7142e0c6 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:25.750367 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-71f5f07c-ec39-4a04-ae94-9cbb7142e0c6 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:25.750847 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-71f5f07c-ec39-4a04-ae94-9cbb7142e0c6 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:25.751281 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-71f5f07c-ec39-4a04-ae94-9cbb7142e0c6 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:25.751974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-71f5f07c-ec39-4a04-ae94-9cbb7142e0c6 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:25.752420 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-71f5f07c-ec39-4a04-ae94-9cbb7142e0c6 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:25.752840 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-71f5f07c-ec39-4a04-ae94-9cbb7142e0c6 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:25.942074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-71f5f07c-ec39-4a04-ae94-9cbb7142e0c6 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:25.950698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-71f5f07c-ec39-4a04-ae94-9cbb7142e0c6 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.210637 Sep 14 12:23:25.951289 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 663/1318] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:25 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:26.474791 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7c446831-77a7-483d-aef4-fc817aac8bcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:26.478183 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7c446831-77a7-483d-aef4-fc817aac8bcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:26.486488 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c446831-77a7-483d-aef4-fc817aac8bcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:26.487084 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c446831-77a7-483d-aef4-fc817aac8bcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:26.487202 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-e3429a31-4e90-4eb2-8c61-7664f13d21d1 req-cded47e2-8a82-41eb-bf49-fe1ca4667800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e2d5b4-de88-42a8-8e7c-d6dd04c49794", "name": "network-vif-deleted", "tag": "3e4b4210-37df-4a36-8bce-d12d7d842ae2"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:26.487651 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c446831-77a7-483d-aef4-fc817aac8bcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:26.488314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c446831-77a7-483d-aef4-fc817aac8bcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:26.488900 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c446831-77a7-483d-aef4-fc817aac8bcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:26.489410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7c446831-77a7-483d-aef4-fc817aac8bcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:26.498258 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-e3429a31-4e90-4eb2-8c61-7664f13d21d1 req-cded47e2-8a82-41eb-bf49-fe1ca4667800 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:26.498744 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-e3429a31-4e90-4eb2-8c61-7664f13d21d1 req-cded47e2-8a82-41eb-bf49-fe1ca4667800 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:26.499181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-e3429a31-4e90-4eb2-8c61-7664f13d21d1 req-cded47e2-8a82-41eb-bf49-fe1ca4667800 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:26.517884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-e3429a31-4e90-4eb2-8c61-7664f13d21d1 req-cded47e2-8a82-41eb-bf49-fe1ca4667800 service nova] Creating event network-vif-deleted:3e4b4210-37df-4a36-8bce-d12d7d842ae2 for instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 on hv-cinder-84496 Sep 14 12:23:26.524258 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-e3429a31-4e90-4eb2-8c61-7664f13d21d1 req-cded47e2-8a82-41eb-bf49-fe1ca4667800 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040740 Sep 14 12:23:26.528756 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 664/1319] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:23:26.534886 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5f0c5b65-7332-465b-8f17-48a9a476e2eb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:26.535960 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5f0c5b65-7332-465b-8f17-48a9a476e2eb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:26.543839 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b65-7332-465b-8f17-48a9a476e2eb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:26.547018 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b65-7332-465b-8f17-48a9a476e2eb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:26.547372 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b65-7332-465b-8f17-48a9a476e2eb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:26.548232 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b65-7332-465b-8f17-48a9a476e2eb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:26.548715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b65-7332-465b-8f17-48a9a476e2eb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:26.549150 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5f0c5b65-7332-465b-8f17-48a9a476e2eb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:26.585085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7c446831-77a7-483d-aef4-fc817aac8bcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:26.593512 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7c446831-77a7-483d-aef4-fc817aac8bcb tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1510 microversion: 2.1 time: 0.123173 Sep 14 12:23:26.608947 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 656/1320] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:26 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1510 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:26.718321 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5f0c5b65-7332-465b-8f17-48a9a476e2eb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:26.729826 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5f0c5b65-7332-465b-8f17-48a9a476e2eb tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.199124 Sep 14 12:23:26.730557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 665/1321] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:26 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:26.972691 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-28b82aad-9d14-4b32-b8c2-7d8186366df7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:26.973221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-28b82aad-9d14-4b32-b8c2-7d8186366df7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:26.980035 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28b82aad-9d14-4b32-b8c2-7d8186366df7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:26.980523 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28b82aad-9d14-4b32-b8c2-7d8186366df7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:26.981618 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28b82aad-9d14-4b32-b8c2-7d8186366df7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:26.982328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28b82aad-9d14-4b32-b8c2-7d8186366df7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:26.982783 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28b82aad-9d14-4b32-b8c2-7d8186366df7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:26.983207 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-28b82aad-9d14-4b32-b8c2-7d8186366df7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:27.112977 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-28b82aad-9d14-4b32-b8c2-7d8186366df7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:27.121181 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-28b82aad-9d14-4b32-b8c2-7d8186366df7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.152336 Sep 14 12:23:27.122476 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 657/1322] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:26 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:27.618457 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8742029e-1fc2-47cb-bb7a-c975fa9ca352 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:27.619350 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8742029e-1fc2-47cb-bb7a-c975fa9ca352 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:27.626368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8742029e-1fc2-47cb-bb7a-c975fa9ca352 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:27.626873 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8742029e-1fc2-47cb-bb7a-c975fa9ca352 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:27.627386 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8742029e-1fc2-47cb-bb7a-c975fa9ca352 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:27.628025 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8742029e-1fc2-47cb-bb7a-c975fa9ca352 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:27.628477 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8742029e-1fc2-47cb-bb7a-c975fa9ca352 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:27.628910 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8742029e-1fc2-47cb-bb7a-c975fa9ca352 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:27.698974 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8742029e-1fc2-47cb-bb7a-c975fa9ca352 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:27.707915 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8742029e-1fc2-47cb-bb7a-c975fa9ca352 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1225 microversion: 2.1 time: 0.093444 Sep 14 12:23:27.708498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 666/1323] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:27 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:27.755059 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d4542758-8497-4a59-a932-5520afd5eb34 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:27.756067 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d4542758-8497-4a59-a932-5520afd5eb34 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:27.762662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4542758-8497-4a59-a932-5520afd5eb34 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:27.763141 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4542758-8497-4a59-a932-5520afd5eb34 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:27.763584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4542758-8497-4a59-a932-5520afd5eb34 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:27.764265 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4542758-8497-4a59-a932-5520afd5eb34 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:27.764945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4542758-8497-4a59-a932-5520afd5eb34 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:27.765134 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d4542758-8497-4a59-a932-5520afd5eb34 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:27.907472 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d4542758-8497-4a59-a932-5520afd5eb34 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:27.915358 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d4542758-8497-4a59-a932-5520afd5eb34 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.164219 Sep 14 12:23:27.915928 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 658/1324] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:27 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:28.144611 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0ffdfc9d-fe28-424f-9611-b00f0746b959 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:28.145227 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0ffdfc9d-fe28-424f-9611-b00f0746b959 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:28.151283 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc9d-fe28-424f-9611-b00f0746b959 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:28.151771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc9d-fe28-424f-9611-b00f0746b959 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:28.152208 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc9d-fe28-424f-9611-b00f0746b959 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:28.153452 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc9d-fe28-424f-9611-b00f0746b959 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:28.153940 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc9d-fe28-424f-9611-b00f0746b959 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:28.154368 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc9d-fe28-424f-9611-b00f0746b959 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:28.284578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0ffdfc9d-fe28-424f-9611-b00f0746b959 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:28.292550 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0ffdfc9d-fe28-424f-9611-b00f0746b959 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.152215 Sep 14 12:23:28.295871 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 667/1325] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:28 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:28.731931 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-fe57ff31-b2dc-496c-95c3-f1c712457139 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:28.732551 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-fe57ff31-b2dc-496c-95c3-f1c712457139 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:28.739027 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe57ff31-b2dc-496c-95c3-f1c712457139 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:28.739531 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe57ff31-b2dc-496c-95c3-f1c712457139 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:28.739993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe57ff31-b2dc-496c-95c3-f1c712457139 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:28.740708 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe57ff31-b2dc-496c-95c3-f1c712457139 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:28.741219 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe57ff31-b2dc-496c-95c3-f1c712457139 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:28.741622 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-fe57ff31-b2dc-496c-95c3-f1c712457139 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:28.807352 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-fe57ff31-b2dc-496c-95c3-f1c712457139 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:28.815851 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-fe57ff31-b2dc-496c-95c3-f1c712457139 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1225 microversion: 2.1 time: 0.088571 Sep 14 12:23:28.816431 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 659/1326] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:28 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:28.939161 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-48b11a75-001e-419c-a743-51183211507f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:28.940099 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-48b11a75-001e-419c-a743-51183211507f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:28.946911 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-48b11a75-001e-419c-a743-51183211507f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:28.947435 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-48b11a75-001e-419c-a743-51183211507f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:28.947879 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-48b11a75-001e-419c-a743-51183211507f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:28.948624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-48b11a75-001e-419c-a743-51183211507f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:28.949084 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-48b11a75-001e-419c-a743-51183211507f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:28.949544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-48b11a75-001e-419c-a743-51183211507f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:29.092318 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-48b11a75-001e-419c-a743-51183211507f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:29.100407 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-48b11a75-001e-419c-a743-51183211507f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1574 microversion: 2.1 time: 0.165259 Sep 14 12:23:29.102203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 668/1327] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:28 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:29.318964 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-24772e40-2384-4ec2-8d8f-63f13b75b971 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:29.319971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-24772e40-2384-4ec2-8d8f-63f13b75b971 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:29.330337 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24772e40-2384-4ec2-8d8f-63f13b75b971 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:29.331166 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24772e40-2384-4ec2-8d8f-63f13b75b971 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:29.331866 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24772e40-2384-4ec2-8d8f-63f13b75b971 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:29.333032 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24772e40-2384-4ec2-8d8f-63f13b75b971 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:29.333804 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24772e40-2384-4ec2-8d8f-63f13b75b971 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:29.334691 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-24772e40-2384-4ec2-8d8f-63f13b75b971 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:29.508185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-24772e40-2384-4ec2-8d8f-63f13b75b971 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:29.516663 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-24772e40-2384-4ec2-8d8f-63f13b75b971 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.204457 Sep 14 12:23:29.517530 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 660/1328] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:29 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:29.841464 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:29.842188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:29.848369 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:29.848942 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:29.849380 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:29.850131 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:29.850591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:29.851024 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:29.886060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:29.886555 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:29.887076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:29.887620 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lazy-loading 'fault' on Instance uuid 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:23:29.937152 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:29.942605 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d42b0e10-e125-4a7d-afba-bcaa2ec245ed tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 200 len: 1230 microversion: 2.1 time: 0.105560 Sep 14 12:23:29.943525 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 669/1329] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:29 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:30.126977 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-50f321d2-2e62-4e5d-86e4-a5ca7deb74a1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:30.127582 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-50f321d2-2e62-4e5d-86e4-a5ca7deb74a1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:30.129920 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:30.135132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50f321d2-2e62-4e5d-86e4-a5ca7deb74a1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:30.135132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50f321d2-2e62-4e5d-86e4-a5ca7deb74a1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:30.135530 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50f321d2-2e62-4e5d-86e4-a5ca7deb74a1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:30.136230 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50f321d2-2e62-4e5d-86e4-a5ca7deb74a1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:30.136685 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50f321d2-2e62-4e5d-86e4-a5ca7deb74a1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:30.137613 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-50f321d2-2e62-4e5d-86e4-a5ca7deb74a1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:30.271457 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-50f321d2-2e62-4e5d-86e4-a5ca7deb74a1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:30.279940 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-50f321d2-2e62-4e5d-86e4-a5ca7deb74a1 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1561 microversion: 2.1 time: 0.157009 Sep 14 12:23:30.280541 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 661/1330] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:30 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:30.541964 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-0d45dc8c-2858-41d2-a60e-e1eb6b7aef5f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:30.542771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-0d45dc8c-2858-41d2-a60e-e1eb6b7aef5f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:30.550044 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d45dc8c-2858-41d2-a60e-e1eb6b7aef5f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:30.550534 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d45dc8c-2858-41d2-a60e-e1eb6b7aef5f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:30.550976 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d45dc8c-2858-41d2-a60e-e1eb6b7aef5f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:30.551672 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d45dc8c-2858-41d2-a60e-e1eb6b7aef5f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:30.552185 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d45dc8c-2858-41d2-a60e-e1eb6b7aef5f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:30.552617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-0d45dc8c-2858-41d2-a60e-e1eb6b7aef5f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:30.687975 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-0d45dc8c-2858-41d2-a60e-e1eb6b7aef5f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:30.697771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-0d45dc8c-2858-41d2-a60e-e1eb6b7aef5f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.160998 Sep 14 12:23:30.698599 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 670/1331] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:30 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:30.964833 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:30.966073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:30.972208 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:30.972715 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:30.973158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:30.973900 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:30.974348 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:30.974787 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:30.988829 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] HTTP exception thrown: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Request method failure captured: Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 HTTP/1.1 Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcbNMIgIGrYMNQSBMTsI6HNeFuUOApp2cYZhcfoQJes_UqSKr9HgdPJ6OleDOKX_ujNQHt1uC-KkM4_MG6V_5xh3itga4eMohCLze80vsKASE2qDG0MhdCl-y31FsgQ4qQSq08i8pnP7LaqGRVeumg5IJfBdN_bMbc98HIxBDeZKIS0 Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: e0cdab1c080d4132adc6cd64d8627c68 Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestVolumeBootPattern-746487349 Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:23:30.990565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0cdab1c080d4132adc6cd64d8627c68"}]}] Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestVolumeBootPattern-746487349 Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: e0cdab1c080d4132adc6cd64d8627c68 Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestVolumeBootPattern-746487349 Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-TestVolumeBootPattern-746487349-project Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 33f480ef1b8b49df83276a66f445ae85 Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestVolumeBootPattern-746487349-project Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:23:30.992379 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '75e2d5b4-de88-42a8-8e7c-d6dd04c49794'} Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:23:30.993563 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:23:30.995444 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:23:30.996945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Returning 404 to user: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:23:30.996945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-76c6241d-b6c8-4bc8-bb38-eee46d888022 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 404 len: 111 microversion: 2.1 time: 0.031251 Sep 14 12:23:30.996945 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 662/1332] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:30 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:23:31.100975 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1668904251", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1225028685", "security_groups": [{"name": "tempest-secgroup-smoke-1914131548"}], "block_device_mapping_v2": [{"uuid": "a3ef7089-16ca-4f51-9a31-45bd6e55e11f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7695930d-2da6-4ee9-8437-3753ca9f2e40"}]}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:31.234624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.network.neutron [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] validate_networks() for [('7695930d-2da6-4ee9-8437-3753ca9f2e40', None, None, None, None, None)] {{(pid=121152) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:23:31.416743 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:31.723065 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d41d7519-a405-4163-b494-9a59411e4287 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:31.723632 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d41d7519-a405-4163-b494-9a59411e4287 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:31.730180 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d41d7519-a405-4163-b494-9a59411e4287 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:31.730726 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d41d7519-a405-4163-b494-9a59411e4287 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:31.731195 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d41d7519-a405-4163-b494-9a59411e4287 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:31.731895 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d41d7519-a405-4163-b494-9a59411e4287 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:31.732348 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d41d7519-a405-4163-b494-9a59411e4287 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:31.732774 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d41d7519-a405-4163-b494-9a59411e4287 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:31.943467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d41d7519-a405-4163-b494-9a59411e4287 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:31.952523 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d41d7519-a405-4163-b494-9a59411e4287 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.233348 Sep 14 12:23:31.953440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 663/1333] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:31 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:31.966204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Flavor limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:23:31.966659 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Image limits 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:23:31.967139 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Flavor pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:23:31.967556 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Image pref 0:0:0 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:23:31.967983 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.virt.hardware [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121152) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:23:31.977187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:31.977602 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:31.978097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:31.978813 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:31.979260 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:31.979708 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:31.996008 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Getting quotas for project e0cdab1c080d4132adc6cd64d8627c68. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:23:32.000828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.quota [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Getting quotas for user 33f480ef1b8b49df83276a66f445ae85 and project e0cdab1c080d4132adc6cd64d8627c68. Resources: {'cores', 'ram', 'instances'} {{(pid=121152) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:23:32.060498 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Going to run 1 instances... {{(pid=121152) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:23:32.062644 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3ef7089-16ca-4f51-9a31-45bd6e55e11f',volume_size=None,volume_type=None)] {{(pid=121152) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:23:32.517007 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-775e6f98-f747-4f52-9886-f9cb2d25b559 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.420133 Sep 14 12:23:32.518843 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 671/1334] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:23:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:23:32.534249 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-261da222-9f0f-4778-a215-4440dbe14275 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:32.535122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-261da222-9f0f-4778-a215-4440dbe14275 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:32.540594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-c692297f-5c38-47eb-8e30-01355af91914 req-dc4b7548-0112-4668-b6ed-256807150b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317a118f-cac5-4462-9a96-2292223af807", "name": "network-vif-plugged", "status": "completed", "tag": "d0116994-2eb1-4246-a0d6-2ce571474c5c"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:32.553275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-c692297f-5c38-47eb-8e30-01355af91914 req-dc4b7548-0112-4668-b6ed-256807150b2d service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:32.553275 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-c692297f-5c38-47eb-8e30-01355af91914 req-dc4b7548-0112-4668-b6ed-256807150b2d service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:32.553744 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-c692297f-5c38-47eb-8e30-01355af91914 req-dc4b7548-0112-4668-b6ed-256807150b2d service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:32.567407 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-c692297f-5c38-47eb-8e30-01355af91914 req-dc4b7548-0112-4668-b6ed-256807150b2d service nova] Creating event network-vif-plugged:d0116994-2eb1-4246-a0d6-2ce571474c5c for instance 317a118f-cac5-4462-9a96-2292223af807 on hv-cinder-84496 Sep 14 12:23:32.576937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-c692297f-5c38-47eb-8e30-01355af91914 req-dc4b7548-0112-4668-b6ed-256807150b2d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045251 Sep 14 12:23:32.582221 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 672/1335] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:23:32.601823 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-261da222-9f0f-4778-a215-4440dbe14275 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:32.609761 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-261da222-9f0f-4778-a215-4440dbe14275 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1095 microversion: 2.1 time: 0.080078 Sep 14 12:23:32.610623 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 664/1336] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:32 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:32.976982 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c2ddc994-cfe4-4fbd-8de9-db8be5970cc8 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:32.977698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c2ddc994-cfe4-4fbd-8de9-db8be5970cc8 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:32.990158 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2ddc994-cfe4-4fbd-8de9-db8be5970cc8 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:32.999156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2ddc994-cfe4-4fbd-8de9-db8be5970cc8 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:32.999156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2ddc994-cfe4-4fbd-8de9-db8be5970cc8 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:32.999156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2ddc994-cfe4-4fbd-8de9-db8be5970cc8 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:32.999156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2ddc994-cfe4-4fbd-8de9-db8be5970cc8 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:33.000112 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c2ddc994-cfe4-4fbd-8de9-db8be5970cc8 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:33.143582 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c2ddc994-cfe4-4fbd-8de9-db8be5970cc8 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:33.151521 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c2ddc994-cfe4-4fbd-8de9-db8be5970cc8 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.179122 Sep 14 12:23:33.152094 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 673/1337] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:32 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:33.632522 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2898e3f5-1f4a-4023-a935-4578aac7dbdf tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:33.633138 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2898e3f5-1f4a-4023-a935-4578aac7dbdf tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:33.641155 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2898e3f5-1f4a-4023-a935-4578aac7dbdf tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:33.641645 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2898e3f5-1f4a-4023-a935-4578aac7dbdf tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:33.642122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2898e3f5-1f4a-4023-a935-4578aac7dbdf tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:33.642813 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2898e3f5-1f4a-4023-a935-4578aac7dbdf tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:33.643540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2898e3f5-1f4a-4023-a935-4578aac7dbdf tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:33.643978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2898e3f5-1f4a-4023-a935-4578aac7dbdf tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:33.704434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2898e3f5-1f4a-4023-a935-4578aac7dbdf tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:33.712287 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2898e3f5-1f4a-4023-a935-4578aac7dbdf tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1145 microversion: 2.1 time: 0.083696 Sep 14 12:23:33.712861 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 665/1338] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:33 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:34.177066 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-91e8d243-b874-4e0c-ae79-afc629cd4e1e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:34.177945 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-91e8d243-b874-4e0c-ae79-afc629cd4e1e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:34.186874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-91e8d243-b874-4e0c-ae79-afc629cd4e1e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:34.187445 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-91e8d243-b874-4e0c-ae79-afc629cd4e1e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:34.187888 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-91e8d243-b874-4e0c-ae79-afc629cd4e1e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:34.188652 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-91e8d243-b874-4e0c-ae79-afc629cd4e1e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:34.189111 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-91e8d243-b874-4e0c-ae79-afc629cd4e1e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:34.189537 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-91e8d243-b874-4e0c-ae79-afc629cd4e1e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:34.333772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-91e8d243-b874-4e0c-ae79-afc629cd4e1e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:34.342244 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-91e8d243-b874-4e0c-ae79-afc629cd4e1e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1358 microversion: 2.1 time: 0.169763 Sep 14 12:23:34.342827 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 674/1339] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:34 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:34.735047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-121f8e7b-b0c6-4c1a-b356-31d95e914f3b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:34.735662 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-121f8e7b-b0c6-4c1a-b356-31d95e914f3b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:34.742231 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-121f8e7b-b0c6-4c1a-b356-31d95e914f3b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:34.742729 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-121f8e7b-b0c6-4c1a-b356-31d95e914f3b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:34.743174 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-121f8e7b-b0c6-4c1a-b356-31d95e914f3b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:34.743880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-121f8e7b-b0c6-4c1a-b356-31d95e914f3b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:34.744337 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-121f8e7b-b0c6-4c1a-b356-31d95e914f3b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:34.744765 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-121f8e7b-b0c6-4c1a-b356-31d95e914f3b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:34.812426 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-121f8e7b-b0c6-4c1a-b356-31d95e914f3b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:34.822689 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-121f8e7b-b0c6-4c1a-b356-31d95e914f3b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1137 microversion: 2.1 time: 0.089380 Sep 14 12:23:34.822689 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 666/1340] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:34 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:35.365315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3b933dd8-786c-426e-a064-90b02ce5c7a5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:35.365937 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3b933dd8-786c-426e-a064-90b02ce5c7a5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:35.373082 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b933dd8-786c-426e-a064-90b02ce5c7a5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:35.373557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b933dd8-786c-426e-a064-90b02ce5c7a5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:35.374055 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b933dd8-786c-426e-a064-90b02ce5c7a5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:35.374737 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b933dd8-786c-426e-a064-90b02ce5c7a5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:35.375178 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b933dd8-786c-426e-a064-90b02ce5c7a5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:35.375591 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3b933dd8-786c-426e-a064-90b02ce5c7a5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:35.510536 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3b933dd8-786c-426e-a064-90b02ce5c7a5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:35.518975 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3b933dd8-786c-426e-a064-90b02ce5c7a5 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1547 microversion: 2.1 time: 0.157573 Sep 14 12:23:35.519553 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 675/1341] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:35 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:35.546869 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-f98a8381-1fba-4e80-89b5-01ce49937014 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:35.551325 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-f98a8381-1fba-4e80-89b5-01ce49937014 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:35.555160 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98a8381-1fba-4e80-89b5-01ce49937014 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:35.555740 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98a8381-1fba-4e80-89b5-01ce49937014 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:35.556278 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98a8381-1fba-4e80-89b5-01ce49937014 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:35.556972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98a8381-1fba-4e80-89b5-01ce49937014 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:35.557419 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98a8381-1fba-4e80-89b5-01ce49937014 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:35.557842 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-f98a8381-1fba-4e80-89b5-01ce49937014 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:35.561023 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=100 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:35.699082 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-f98a8381-1fba-4e80-89b5-01ce49937014 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:35.708498 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-f98a8381-1fba-4e80-89b5-01ce49937014 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1547 microversion: 2.1 time: 0.169274 Sep 14 12:23:35.709022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 667/1342] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:35 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:35.730493 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:35.735578 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:35.736925 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Searching by: {'deleted': False, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949'} {{(pid=121152) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 12:23:35.744070 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:35.744539 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:35.745210 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:35.745717 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:35.746698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:35.747116 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:35.846548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.multi_cell_list [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121152) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 12:23:35.850584 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7ed22293-1194-4768-9df1-22eeb9f609db tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:35.851202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7ed22293-1194-4768-9df1-22eeb9f609db tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:35.860647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ed22293-1194-4768-9df1-22eeb9f609db tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:35.865517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ed22293-1194-4768-9df1-22eeb9f609db tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:35.865517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ed22293-1194-4768-9df1-22eeb9f609db tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:35.865517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ed22293-1194-4768-9df1-22eeb9f609db tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:35.865517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ed22293-1194-4768-9df1-22eeb9f609db tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:35.866046 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7ed22293-1194-4768-9df1-22eeb9f609db tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:35.934679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7ed22293-1194-4768-9df1-22eeb9f609db tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:35.942803 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7ed22293-1194-4768-9df1-22eeb9f609db tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1201 microversion: 2.1 time: 0.097705 Sep 14 12:23:35.950372 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 668/1343] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:35 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:35.966950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3ca7ec76-2ffd-412e-8fe9-3421ed2ea790 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.240226 Sep 14 12:23:35.967465 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 676/1344] 10.222.0.62 () {58 vars in 1125 bytes} [Wed Sep 14 12:23:35 2022] GET /compute/v2.1/servers => generated 342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:23:35.979451 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1ef13d34-fe78-4c84-b735-1283cf2563f9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:35.980100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1ef13d34-fe78-4c84-b735-1283cf2563f9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:35.986890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ef13d34-fe78-4c84-b735-1283cf2563f9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:35.987371 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ef13d34-fe78-4c84-b735-1283cf2563f9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:35.987806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ef13d34-fe78-4c84-b735-1283cf2563f9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:35.988493 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ef13d34-fe78-4c84-b735-1283cf2563f9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:35.988942 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ef13d34-fe78-4c84-b735-1283cf2563f9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:35.989359 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1ef13d34-fe78-4c84-b735-1283cf2563f9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:36.124119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1ef13d34-fe78-4c84-b735-1283cf2563f9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:36.132305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1ef13d34-fe78-4c84-b735-1283cf2563f9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1547 microversion: 2.1 time: 0.156652 Sep 14 12:23:36.132878 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 669/1345] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:35 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:36.965495 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-06d06334-c6db-4dea-ae6c-fc278e585ae3 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:36.969604 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-06d06334-c6db-4dea-ae6c-fc278e585ae3 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:36.977184 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06d06334-c6db-4dea-ae6c-fc278e585ae3 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:36.977673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06d06334-c6db-4dea-ae6c-fc278e585ae3 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:36.978142 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06d06334-c6db-4dea-ae6c-fc278e585ae3 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:36.978859 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06d06334-c6db-4dea-ae6c-fc278e585ae3 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:36.979303 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06d06334-c6db-4dea-ae6c-fc278e585ae3 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:36.979721 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-06d06334-c6db-4dea-ae6c-fc278e585ae3 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:37.138986 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-06d06334-c6db-4dea-ae6c-fc278e585ae3 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:37.147894 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-06d06334-c6db-4dea-ae6c-fc278e585ae3 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1279 microversion: 2.1 time: 0.186977 Sep 14 12:23:37.148492 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 677/1346] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:36 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1279 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:38.010396 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-98015e52-69f7-48fd-9b05-5a7642f96746 req-c317c920-72f7-476c-a6c4-7104e80194b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888bde55-8bd0-4899-b628-248ceca236ec", "tag": "36821828-5ed7-4142-9e1b-7030c1d1b519"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:38.024066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-98015e52-69f7-48fd-9b05-5a7642f96746 req-c317c920-72f7-476c-a6c4-7104e80194b4 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:38.024561 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-98015e52-69f7-48fd-9b05-5a7642f96746 req-c317c920-72f7-476c-a6c4-7104e80194b4 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:38.025002 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-98015e52-69f7-48fd-9b05-5a7642f96746 req-c317c920-72f7-476c-a6c4-7104e80194b4 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:38.037850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-98015e52-69f7-48fd-9b05-5a7642f96746 req-c317c920-72f7-476c-a6c4-7104e80194b4 service nova] Creating event network-changed:36821828-5ed7-4142-9e1b-7030c1d1b519 for instance 888bde55-8bd0-4899-b628-248ceca236ec on hv-cinder-84496 Sep 14 12:23:38.043956 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-98015e52-69f7-48fd-9b05-5a7642f96746 req-c317c920-72f7-476c-a6c4-7104e80194b4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037986 Sep 14 12:23:38.044570 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 670/1347] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:23:38.172196 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-3a391e64-815b-46cf-8ed5-9f2b6430dd0e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:38.173129 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-3a391e64-815b-46cf-8ed5-9f2b6430dd0e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:38.180597 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a391e64-815b-46cf-8ed5-9f2b6430dd0e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:38.181088 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a391e64-815b-46cf-8ed5-9f2b6430dd0e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:38.181932 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a391e64-815b-46cf-8ed5-9f2b6430dd0e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:38.182740 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a391e64-815b-46cf-8ed5-9f2b6430dd0e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:38.183280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a391e64-815b-46cf-8ed5-9f2b6430dd0e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:38.184143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-3a391e64-815b-46cf-8ed5-9f2b6430dd0e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:38.187258 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=100 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:38.331287 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-3a391e64-815b-46cf-8ed5-9f2b6430dd0e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:38.339664 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-3a391e64-815b-46cf-8ed5-9f2b6430dd0e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.171447 Sep 14 12:23:38.340271 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 678/1348] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:38 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:39.265511 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2b6e38f4-e1e5-48cc-9df1-54cd8cded03b tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79ced0bc-a378-458b-94f2-145044664be1"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:39.268210 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2b6e38f4-e1e5-48cc-9df1-54cd8cded03b tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:39.274304 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b6e38f4-e1e5-48cc-9df1-54cd8cded03b tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:39.274784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b6e38f4-e1e5-48cc-9df1-54cd8cded03b tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:39.275214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b6e38f4-e1e5-48cc-9df1-54cd8cded03b tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:39.275901 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b6e38f4-e1e5-48cc-9df1-54cd8cded03b tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:39.276349 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b6e38f4-e1e5-48cc-9df1-54cd8cded03b tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:39.276766 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2b6e38f4-e1e5-48cc-9df1-54cd8cded03b tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:39.362601 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8e4b68eb-485a-4197-a02f-64cec02905ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:39.363226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8e4b68eb-485a-4197-a02f-64cec02905ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:39.369696 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8e4b68eb-485a-4197-a02f-64cec02905ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:39.370217 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8e4b68eb-485a-4197-a02f-64cec02905ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:39.370658 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8e4b68eb-485a-4197-a02f-64cec02905ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:39.371916 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8e4b68eb-485a-4197-a02f-64cec02905ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:39.372372 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8e4b68eb-485a-4197-a02f-64cec02905ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:39.372801 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8e4b68eb-485a-4197-a02f-64cec02905ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:39.511394 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8e4b68eb-485a-4197-a02f-64cec02905ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:39.519342 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8e4b68eb-485a-4197-a02f-64cec02905ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.160655 Sep 14 12:23:39.519915 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 679/1349] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:39 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:40.541837 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-10921956-7607-4d57-8e13-1ecf1eb764c4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:40.542546 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-10921956-7607-4d57-8e13-1ecf1eb764c4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:40.549766 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-10921956-7607-4d57-8e13-1ecf1eb764c4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:40.550282 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-10921956-7607-4d57-8e13-1ecf1eb764c4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:40.550709 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-10921956-7607-4d57-8e13-1ecf1eb764c4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:40.551421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-10921956-7607-4d57-8e13-1ecf1eb764c4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:40.551861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-10921956-7607-4d57-8e13-1ecf1eb764c4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:40.552280 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-10921956-7607-4d57-8e13-1ecf1eb764c4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:40.610972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2b6e38f4-e1e5-48cc-9df1-54cd8cded03b tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "POST /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.350631 Sep 14 12:23:40.612029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 671/1350] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Sep 14 12:23:39 2022] POST /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments => generated 194 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:23:40.704557 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-10921956-7607-4d57-8e13-1ecf1eb764c4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:40.712949 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-10921956-7607-4d57-8e13-1ecf1eb764c4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.175022 Sep 14 12:23:40.713880 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 680/1351] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:40 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:41.736680 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-060221c3-4a8c-41d1-8898-84bcfd2a5f92 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:41.737392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-060221c3-4a8c-41d1-8898-84bcfd2a5f92 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:41.744780 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060221c3-4a8c-41d1-8898-84bcfd2a5f92 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:41.745354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060221c3-4a8c-41d1-8898-84bcfd2a5f92 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:41.745701 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060221c3-4a8c-41d1-8898-84bcfd2a5f92 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:41.746957 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060221c3-4a8c-41d1-8898-84bcfd2a5f92 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:41.747464 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060221c3-4a8c-41d1-8898-84bcfd2a5f92 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:41.747842 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-060221c3-4a8c-41d1-8898-84bcfd2a5f92 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:41.891598 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-060221c3-4a8c-41d1-8898-84bcfd2a5f92 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:41.900474 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-060221c3-4a8c-41d1-8898-84bcfd2a5f92 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.168130 Sep 14 12:23:41.901268 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 672/1352] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:41 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:42.923441 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-1dd8f2c4-a8f7-4bde-bd12-d9f0e5870e70 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:42.924299 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-1dd8f2c4-a8f7-4bde-bd12-d9f0e5870e70 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:42.926776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=6 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:42.931921 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dd8f2c4-a8f7-4bde-bd12-d9f0e5870e70 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:42.932416 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dd8f2c4-a8f7-4bde-bd12-d9f0e5870e70 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:42.932855 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dd8f2c4-a8f7-4bde-bd12-d9f0e5870e70 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:42.933558 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dd8f2c4-a8f7-4bde-bd12-d9f0e5870e70 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:42.934075 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dd8f2c4-a8f7-4bde-bd12-d9f0e5870e70 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:42.934873 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-1dd8f2c4-a8f7-4bde-bd12-d9f0e5870e70 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:43.077812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-1dd8f2c4-a8f7-4bde-bd12-d9f0e5870e70 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:43.085789 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-1dd8f2c4-a8f7-4bde-bd12-d9f0e5870e70 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.166308 Sep 14 12:23:43.089887 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 681/1353] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:42 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:44.108289 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-da439cb0-3576-45c3-ba63-7945a76af61a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:44.108930 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-da439cb0-3576-45c3-ba63-7945a76af61a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:44.110991 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:44.116303 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da439cb0-3576-45c3-ba63-7945a76af61a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:44.116788 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da439cb0-3576-45c3-ba63-7945a76af61a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:44.117374 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da439cb0-3576-45c3-ba63-7945a76af61a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:44.118101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da439cb0-3576-45c3-ba63-7945a76af61a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:44.118550 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da439cb0-3576-45c3-ba63-7945a76af61a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:44.118979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-da439cb0-3576-45c3-ba63-7945a76af61a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:44.258031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-da439cb0-3576-45c3-ba63-7945a76af61a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:44.266722 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-da439cb0-3576-45c3-ba63-7945a76af61a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.162493 Sep 14 12:23:44.267297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 673/1354] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:44 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:23:45.289120 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-01906c30-0ea6-4ce0-ad89-06922f139c9b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:45.289726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-01906c30-0ea6-4ce0-ad89-06922f139c9b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:45.296569 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01906c30-0ea6-4ce0-ad89-06922f139c9b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:45.297052 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01906c30-0ea6-4ce0-ad89-06922f139c9b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:45.297470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01906c30-0ea6-4ce0-ad89-06922f139c9b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:45.298190 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01906c30-0ea6-4ce0-ad89-06922f139c9b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:45.298645 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01906c30-0ea6-4ce0-ad89-06922f139c9b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:45.299144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-01906c30-0ea6-4ce0-ad89-06922f139c9b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:45.432479 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-01906c30-0ea6-4ce0-ad89-06922f139c9b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:45.440525 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-01906c30-0ea6-4ce0-ad89-06922f139c9b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.155193 Sep 14 12:23:45.441113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 682/1355] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:45 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:46.462840 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-8e9f3fc0-93a7-43aa-9a22-d5ca108018b7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:46.463421 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-8e9f3fc0-93a7-43aa-9a22-d5ca108018b7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:46.469972 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fc0-93a7-43aa-9a22-d5ca108018b7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:46.470454 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fc0-93a7-43aa-9a22-d5ca108018b7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:46.470885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fc0-93a7-43aa-9a22-d5ca108018b7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:46.471568 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fc0-93a7-43aa-9a22-d5ca108018b7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:46.472066 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fc0-93a7-43aa-9a22-d5ca108018b7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:46.472486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fc0-93a7-43aa-9a22-d5ca108018b7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:46.607222 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-8e9f3fc0-93a7-43aa-9a22-d5ca108018b7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:46.615442 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-8e9f3fc0-93a7-43aa-9a22-d5ca108018b7 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.156384 Sep 14 12:23:46.616033 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 674/1356] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:46 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:47.639191 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d3322057-2386-428c-80b2-27a45b869811 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:47.639877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d3322057-2386-428c-80b2-27a45b869811 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:47.641961 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=4 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:23:47.648438 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3322057-2386-428c-80b2-27a45b869811 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:47.648914 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3322057-2386-428c-80b2-27a45b869811 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:47.649342 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3322057-2386-428c-80b2-27a45b869811 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:47.650127 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3322057-2386-428c-80b2-27a45b869811 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:47.650963 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3322057-2386-428c-80b2-27a45b869811 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:47.651364 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d3322057-2386-428c-80b2-27a45b869811 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:47.877487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d3322057-2386-428c-80b2-27a45b869811 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:47.877487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d3322057-2386-428c-80b2-27a45b869811 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.178142 Sep 14 12:23:47.877487 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 683/1357] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:47 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:48.898908 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ae56ab18-adf5-480b-89a2-5fa95ee25d2c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:48.899537 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ae56ab18-adf5-480b-89a2-5fa95ee25d2c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:48.906753 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae56ab18-adf5-480b-89a2-5fa95ee25d2c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:48.907240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae56ab18-adf5-480b-89a2-5fa95ee25d2c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:48.907730 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae56ab18-adf5-480b-89a2-5fa95ee25d2c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:48.908437 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae56ab18-adf5-480b-89a2-5fa95ee25d2c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:48.908896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae56ab18-adf5-480b-89a2-5fa95ee25d2c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:48.909323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ae56ab18-adf5-480b-89a2-5fa95ee25d2c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:49.047410 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-ae56ab18-adf5-480b-89a2-5fa95ee25d2c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:49.055045 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ae56ab18-adf5-480b-89a2-5fa95ee25d2c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.160094 Sep 14 12:23:49.055608 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 675/1358] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:48 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:49.306078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-15cf24d8-81a7-428c-bc4a-d8df7937ffe1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:49.310022 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-15cf24d8-81a7-428c-bc4a-d8df7937ffe1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:49.313772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15cf24d8-81a7-428c-bc4a-d8df7937ffe1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:49.314295 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15cf24d8-81a7-428c-bc4a-d8df7937ffe1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:49.314732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15cf24d8-81a7-428c-bc4a-d8df7937ffe1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:49.315423 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15cf24d8-81a7-428c-bc4a-d8df7937ffe1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:49.315881 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15cf24d8-81a7-428c-bc4a-d8df7937ffe1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:49.316716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-15cf24d8-81a7-428c-bc4a-d8df7937ffe1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:49.446138 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-15cf24d8-81a7-428c-bc4a-d8df7937ffe1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:49.455028 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-15cf24d8-81a7-428c-bc4a-d8df7937ffe1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1593 microversion: 2.1 time: 0.153259 Sep 14 12:23:49.455603 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 684/1359] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:49 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:50.076749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3044fd87-29e2-4774-a935-48d1e9417bc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:50.079486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3044fd87-29e2-4774-a935-48d1e9417bc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:50.083907 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3044fd87-29e2-4774-a935-48d1e9417bc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:50.084399 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3044fd87-29e2-4774-a935-48d1e9417bc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:50.084839 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3044fd87-29e2-4774-a935-48d1e9417bc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:50.085543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3044fd87-29e2-4774-a935-48d1e9417bc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:50.086037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3044fd87-29e2-4774-a935-48d1e9417bc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:50.086478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3044fd87-29e2-4774-a935-48d1e9417bc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:50.296048 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3044fd87-29e2-4774-a935-48d1e9417bc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:50.304073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3044fd87-29e2-4774-a935-48d1e9417bc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.231266 Sep 14 12:23:50.309713 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 676/1360] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:50 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:50.684689 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-959b4ef4-e223-4711-9d1a-f764f3e3d203 req-3c0140be-04a7-42d8-ba32-ecffc5b36937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888bde55-8bd0-4899-b628-248ceca236ec", "name": "network-vif-plugged", "status": "completed", "tag": "36821828-5ed7-4142-9e1b-7030c1d1b519"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:50.694779 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-959b4ef4-e223-4711-9d1a-f764f3e3d203 req-3c0140be-04a7-42d8-ba32-ecffc5b36937 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:50.695257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-959b4ef4-e223-4711-9d1a-f764f3e3d203 req-3c0140be-04a7-42d8-ba32-ecffc5b36937 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:50.695684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-959b4ef4-e223-4711-9d1a-f764f3e3d203 req-3c0140be-04a7-42d8-ba32-ecffc5b36937 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:50.706922 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-959b4ef4-e223-4711-9d1a-f764f3e3d203 req-3c0140be-04a7-42d8-ba32-ecffc5b36937 service nova] Creating event network-vif-plugged:36821828-5ed7-4142-9e1b-7030c1d1b519 for instance 888bde55-8bd0-4899-b628-248ceca236ec on hv-cinder-84496 Sep 14 12:23:50.712094 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-959b4ef4-e223-4711-9d1a-f764f3e3d203 req-3c0140be-04a7-42d8-ba32-ecffc5b36937 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031791 Sep 14 12:23:50.712742 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 685/1361] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:23:51.326741 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d3fc6d5f-e16b-4827-92a9-2cdc90cb5219 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:51.327364 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d3fc6d5f-e16b-4827-92a9-2cdc90cb5219 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:51.333930 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3fc6d5f-e16b-4827-92a9-2cdc90cb5219 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:51.334331 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3fc6d5f-e16b-4827-92a9-2cdc90cb5219 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:51.334767 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3fc6d5f-e16b-4827-92a9-2cdc90cb5219 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:51.335468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3fc6d5f-e16b-4827-92a9-2cdc90cb5219 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:51.335921 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3fc6d5f-e16b-4827-92a9-2cdc90cb5219 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:51.336335 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d3fc6d5f-e16b-4827-92a9-2cdc90cb5219 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:51.557403 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d3fc6d5f-e16b-4827-92a9-2cdc90cb5219 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:51.565278 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d3fc6d5f-e16b-4827-92a9-2cdc90cb5219 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.242450 Sep 14 12:23:51.565849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 677/1362] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:51 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:51.799750 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-f83aa363-fd98-443d-ae40-729b9d79e6aa req-8de532d5-4ae3-4a13-9f91-f7ff41580540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317a118f-cac5-4462-9a96-2292223af807", "tag": "d0116994-2eb1-4246-a0d6-2ce571474c5c"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:51.810739 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-f83aa363-fd98-443d-ae40-729b9d79e6aa req-8de532d5-4ae3-4a13-9f91-f7ff41580540 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:51.811316 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-f83aa363-fd98-443d-ae40-729b9d79e6aa req-8de532d5-4ae3-4a13-9f91-f7ff41580540 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:51.811946 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-f83aa363-fd98-443d-ae40-729b9d79e6aa req-8de532d5-4ae3-4a13-9f91-f7ff41580540 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:51.823698 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-f83aa363-fd98-443d-ae40-729b9d79e6aa req-8de532d5-4ae3-4a13-9f91-f7ff41580540 service nova] Creating event network-changed:d0116994-2eb1-4246-a0d6-2ce571474c5c for instance 317a118f-cac5-4462-9a96-2292223af807 on hv-cinder-84496 Sep 14 12:23:51.830458 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-f83aa363-fd98-443d-ae40-729b9d79e6aa req-8de532d5-4ae3-4a13-9f91-f7ff41580540 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035520 Sep 14 12:23:51.831072 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 686/1363] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:23:52.590823 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-522208f7-e8ae-45ff-9046-3b638d474a7f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:52.591990 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-522208f7-e8ae-45ff-9046-3b638d474a7f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:52.602821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-522208f7-e8ae-45ff-9046-3b638d474a7f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:52.604768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-522208f7-e8ae-45ff-9046-3b638d474a7f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:52.604768 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-522208f7-e8ae-45ff-9046-3b638d474a7f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:52.605937 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-522208f7-e8ae-45ff-9046-3b638d474a7f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:52.614057 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-522208f7-e8ae-45ff-9046-3b638d474a7f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:52.614380 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-522208f7-e8ae-45ff-9046-3b638d474a7f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:52.800054 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-522208f7-e8ae-45ff-9046-3b638d474a7f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:52.807805 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-522208f7-e8ae-45ff-9046-3b638d474a7f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1267 microversion: 2.1 time: 0.223302 Sep 14 12:23:52.808514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 678/1364] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:52 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:53.834421 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8a0ad5da-6d1b-4c51-89c3-cfe724c29183 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:53.835781 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8a0ad5da-6d1b-4c51-89c3-cfe724c29183 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:53.843173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5da-6d1b-4c51-89c3-cfe724c29183 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:53.843656 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5da-6d1b-4c51-89c3-cfe724c29183 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:53.844091 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5da-6d1b-4c51-89c3-cfe724c29183 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:53.844780 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5da-6d1b-4c51-89c3-cfe724c29183 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:53.845226 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5da-6d1b-4c51-89c3-cfe724c29183 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:53.845644 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5da-6d1b-4c51-89c3-cfe724c29183 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:53.998346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8a0ad5da-6d1b-4c51-89c3-cfe724c29183 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:54.001029 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8a0ad5da-6d1b-4c51-89c3-cfe724c29183 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1454 microversion: 2.1 time: 0.173321 Sep 14 12:23:54.001683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 687/1365] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:53 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:54.024918 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5165b270-8494-4d01-904a-25c900c27795 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:54.025610 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5165b270-8494-4d01-904a-25c900c27795 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:54.031515 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5165b270-8494-4d01-904a-25c900c27795 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:54.032332 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5165b270-8494-4d01-904a-25c900c27795 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:54.032513 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5165b270-8494-4d01-904a-25c900c27795 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:54.033095 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5165b270-8494-4d01-904a-25c900c27795 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:54.033547 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5165b270-8494-4d01-904a-25c900c27795 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:54.034002 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5165b270-8494-4d01-904a-25c900c27795 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:54.172926 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5165b270-8494-4d01-904a-25c900c27795 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:54.180958 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5165b270-8494-4d01-904a-25c900c27795 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1454 microversion: 2.1 time: 0.160482 Sep 14 12:23:54.181544 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 679/1366] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:54 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:55.020169 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e7a4c019-81e4-4730-aab8-3c1ceb872428 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-72683924"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:55.026757 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e7a4c019-81e4-4730-aab8-3c1ceb872428 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:55.027337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e7a4c019-81e4-4730-aab8-3c1ceb872428 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:55.027825 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e7a4c019-81e4-4730-aab8-3c1ceb872428 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:55.028906 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e7a4c019-81e4-4730-aab8-3c1ceb872428 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:55.029612 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e7a4c019-81e4-4730-aab8-3c1ceb872428 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:55.030199 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e7a4c019-81e4-4730-aab8-3c1ceb872428 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:55.030626 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e7a4c019-81e4-4730-aab8-3c1ceb872428 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:55.518529 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.network.security_group_api [None req-e7a4c019-81e4-4730-aab8-3c1ceb872428 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Adding security group 6e4ab867-58af-48e3-ab45-f32119a6f2ee to port d0116994-2eb1-4246-a0d6-2ce571474c5c Sep 14 12:23:56.148334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e7a4c019-81e4-4730-aab8-3c1ceb872428 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "POST /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/action" status: 202 len: 0 microversion: 2.1 time: 1.133013 Sep 14 12:23:56.148908 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 688/1367] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:23:55 2022] POST /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/action => generated 0 bytes in 1135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:23:56.158338 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-4829319b-1621-4d65-ac16-d599fc74ddcb tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:23:56.159047 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-4829319b-1621-4d65-ac16-d599fc74ddcb tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:23:56.165913 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4829319b-1621-4d65-ac16-d599fc74ddcb tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:56.166349 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4829319b-1621-4d65-ac16-d599fc74ddcb tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:56.166695 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4829319b-1621-4d65-ac16-d599fc74ddcb tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:56.167105 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-6f7b959e-e0fc-4d0b-9525-c1ca9a424a1c req-db78eae9-7772-4b56-8cff-7886bc9c854c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317a118f-cac5-4462-9a96-2292223af807", "tag": "d0116994-2eb1-4246-a0d6-2ce571474c5c"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:56.167733 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4829319b-1621-4d65-ac16-d599fc74ddcb tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:56.168195 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4829319b-1621-4d65-ac16-d599fc74ddcb tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:56.169782 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-4829319b-1621-4d65-ac16-d599fc74ddcb tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:56.206271 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6f7b959e-e0fc-4d0b-9525-c1ca9a424a1c req-db78eae9-7772-4b56-8cff-7886bc9c854c service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:56.206874 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6f7b959e-e0fc-4d0b-9525-c1ca9a424a1c req-db78eae9-7772-4b56-8cff-7886bc9c854c service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:56.207168 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-6f7b959e-e0fc-4d0b-9525-c1ca9a424a1c req-db78eae9-7772-4b56-8cff-7886bc9c854c service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:56.232011 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-6f7b959e-e0fc-4d0b-9525-c1ca9a424a1c req-db78eae9-7772-4b56-8cff-7886bc9c854c service nova] Creating event network-changed:d0116994-2eb1-4246-a0d6-2ce571474c5c for instance 317a118f-cac5-4462-9a96-2292223af807 on hv-cinder-84496 Sep 14 12:23:56.239734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-6f7b959e-e0fc-4d0b-9525-c1ca9a424a1c req-db78eae9-7772-4b56-8cff-7886bc9c854c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082979 Sep 14 12:23:56.240686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 689/1368] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:23:56.513679 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-4829319b-1621-4d65-ac16-d599fc74ddcb tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:23:56.524785 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-4829319b-1621-4d65-ac16-d599fc74ddcb tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1756 microversion: 2.1 time: 0.370541 Sep 14 12:23:56.539501 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 680/1369] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:23:56 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1756 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:23:58.260350 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-ea24ff4d-c931-4a9d-971b-78f7c3f51fa3 req-0da28589-532a-4661-bba2-9de8a8bad1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888bde55-8bd0-4899-b628-248ceca236ec", "tag": "36821828-5ed7-4142-9e1b-7030c1d1b519"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:23:58.270678 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-ea24ff4d-c931-4a9d-971b-78f7c3f51fa3 req-0da28589-532a-4661-bba2-9de8a8bad1ab service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:23:58.271158 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-ea24ff4d-c931-4a9d-971b-78f7c3f51fa3 req-0da28589-532a-4661-bba2-9de8a8bad1ab service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:23:58.271584 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-ea24ff4d-c931-4a9d-971b-78f7c3f51fa3 req-0da28589-532a-4661-bba2-9de8a8bad1ab service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:23:58.283770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-ea24ff4d-c931-4a9d-971b-78f7c3f51fa3 req-0da28589-532a-4661-bba2-9de8a8bad1ab service nova] Creating event network-changed:36821828-5ed7-4142-9e1b-7030c1d1b519 for instance 888bde55-8bd0-4899-b628-248ceca236ec on hv-cinder-84496 Sep 14 12:23:58.297004 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-ea24ff4d-c931-4a9d-971b-78f7c3f51fa3 req-0da28589-532a-4661-bba2-9de8a8bad1ab service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041033 Sep 14 12:23:58.297771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 690/1370] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:25:17.835348 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=41 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:25:17.835928 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:25:17.836337 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=59 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:25:17.837543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:25:17.843087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-b09dba92-1ef5-4185-a3e5-e3278c8830ae req-d9506b34-dcfd-4d35-ba55-5269ba4be5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921553b2-7c2b-4ec6-80c9-23298af50994", "tag": "f37c6abe-5567-400c-b0bd-04c3772b1a60"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:25:17.852884 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ea1b6366-813a-4394-9b3a-d07d25be6176 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:17.852884 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ea1b6366-813a-4394-9b3a-d07d25be6176 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:17.852884 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea1b6366-813a-4394-9b3a-d07d25be6176 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:17.852884 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea1b6366-813a-4394-9b3a-d07d25be6176 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:17.853368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea1b6366-813a-4394-9b3a-d07d25be6176 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:17.853368 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea1b6366-813a-4394-9b3a-d07d25be6176 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:17.853715 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b09dba92-1ef5-4185-a3e5-e3278c8830ae req-d9506b34-dcfd-4d35-ba55-5269ba4be5a2 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:17.854037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea1b6366-813a-4394-9b3a-d07d25be6176 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:17.854350 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b09dba92-1ef5-4185-a3e5-e3278c8830ae req-d9506b34-dcfd-4d35-ba55-5269ba4be5a2 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:17.854775 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-b09dba92-1ef5-4185-a3e5-e3278c8830ae req-d9506b34-dcfd-4d35-ba55-5269ba4be5a2 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:17.854912 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ea1b6366-813a-4394-9b3a-d07d25be6176 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:17.867760 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-b09dba92-1ef5-4185-a3e5-e3278c8830ae req-d9506b34-dcfd-4d35-ba55-5269ba4be5a2 service nova] Creating event network-changed:f37c6abe-5567-400c-b0bd-04c3772b1a60 for instance 921553b2-7c2b-4ec6-80c9-23298af50994 on hv-cinder-84496 Sep 14 12:25:17.872950 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-b09dba92-1ef5-4185-a3e5-e3278c8830ae req-d9506b34-dcfd-4d35-ba55-5269ba4be5a2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039590 Sep 14 12:25:17.881419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 691/1371] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:25:17.884328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ea1b6366-813a-4394-9b3a-d07d25be6176 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:25:18.340377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ea1b6366-813a-4394-9b3a-d07d25be6176 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "DELETE /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 204 len: 0 microversion: 2.1 time: 0.507067 Sep 14 12:25:18.342554 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 681/1372] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:25:17 2022] DELETE /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:25:18.350643 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-85741241-c6d4-4504-ba2c-a11554c322ed tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:18.351472 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-85741241-c6d4-4504-ba2c-a11554c322ed tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:18.359098 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85741241-c6d4-4504-ba2c-a11554c322ed tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:18.359594 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85741241-c6d4-4504-ba2c-a11554c322ed tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:18.360034 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85741241-c6d4-4504-ba2c-a11554c322ed tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:18.360772 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85741241-c6d4-4504-ba2c-a11554c322ed tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:18.361225 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85741241-c6d4-4504-ba2c-a11554c322ed tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:18.361673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-85741241-c6d4-4504-ba2c-a11554c322ed tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:18.504203 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-85741241-c6d4-4504-ba2c-a11554c322ed tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:18.511947 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-85741241-c6d4-4504-ba2c-a11554c322ed tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.166172 Sep 14 12:25:18.512530 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 692/1373] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:18 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:19.413849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dfcdb1b4-d5e8-4881-80bb-633c0f634088 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:25:19.416244 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dfcdb1b4-d5e8-4881-80bb-633c0f634088 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:19.422668 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfcdb1b4-d5e8-4881-80bb-633c0f634088 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:19.423149 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfcdb1b4-d5e8-4881-80bb-633c0f634088 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:19.423581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfcdb1b4-d5e8-4881-80bb-633c0f634088 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:19.424263 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfcdb1b4-d5e8-4881-80bb-633c0f634088 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:19.424710 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfcdb1b4-d5e8-4881-80bb-633c0f634088 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:19.425749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dfcdb1b4-d5e8-4881-80bb-633c0f634088 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:19.535771 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-54dff6f9-20b0-4a0a-b58c-3a3e37d5ad75 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:19.536390 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-54dff6f9-20b0-4a0a-b58c-3a3e37d5ad75 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:19.542817 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54dff6f9-20b0-4a0a-b58c-3a3e37d5ad75 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:19.543296 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54dff6f9-20b0-4a0a-b58c-3a3e37d5ad75 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:19.543726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54dff6f9-20b0-4a0a-b58c-3a3e37d5ad75 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:19.544400 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54dff6f9-20b0-4a0a-b58c-3a3e37d5ad75 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:19.544896 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54dff6f9-20b0-4a0a-b58c-3a3e37d5ad75 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:19.545300 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-54dff6f9-20b0-4a0a-b58c-3a3e37d5ad75 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:19.635607 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dfcdb1b4-d5e8-4881-80bb-633c0f634088 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "POST /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/action" status: 202 len: 0 microversion: 2.1 time: 0.225831 Sep 14 12:25:19.636565 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 682/1374] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:25:19 2022] POST /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:25:19.645578 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3ef001d7-58c0-4a61-bc23-2886d7e5a67d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:19.646323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3ef001d7-58c0-4a61-bc23-2886d7e5a67d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:19.652878 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ef001d7-58c0-4a61-bc23-2886d7e5a67d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:19.653377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ef001d7-58c0-4a61-bc23-2886d7e5a67d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:19.653821 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ef001d7-58c0-4a61-bc23-2886d7e5a67d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:19.654660 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ef001d7-58c0-4a61-bc23-2886d7e5a67d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:19.655120 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ef001d7-58c0-4a61-bc23-2886d7e5a67d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:19.655550 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3ef001d7-58c0-4a61-bc23-2886d7e5a67d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:19.691564 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-54dff6f9-20b0-4a0a-b58c-3a3e37d5ad75 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:19.700388 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-54dff6f9-20b0-4a0a-b58c-3a3e37d5ad75 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1567 microversion: 2.1 time: 0.168426 Sep 14 12:25:19.707724 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 693/1375] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:19 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:25:19.810199 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3ef001d7-58c0-4a61-bc23-2886d7e5a67d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:19.819915 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3ef001d7-58c0-4a61-bc23-2886d7e5a67d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1748 microversion: 2.1 time: 0.178745 Sep 14 12:25:19.820551 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 683/1376] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:19 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1748 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:25:20.724317 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-93055025-83cf-4546-af6d-1f01039c8935 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:20.724956 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-93055025-83cf-4546-af6d-1f01039c8935 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:20.731785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-93055025-83cf-4546-af6d-1f01039c8935 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:20.732546 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-93055025-83cf-4546-af6d-1f01039c8935 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:20.733179 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-93055025-83cf-4546-af6d-1f01039c8935 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:20.733991 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-93055025-83cf-4546-af6d-1f01039c8935 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:20.734736 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-93055025-83cf-4546-af6d-1f01039c8935 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:20.735128 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-93055025-83cf-4546-af6d-1f01039c8935 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:20.844256 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-42ac4664-f941-4242-825f-160f030aa492 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:20.845158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-42ac4664-f941-4242-825f-160f030aa492 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:20.852536 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42ac4664-f941-4242-825f-160f030aa492 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:20.853128 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42ac4664-f941-4242-825f-160f030aa492 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:20.853824 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42ac4664-f941-4242-825f-160f030aa492 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:20.854772 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42ac4664-f941-4242-825f-160f030aa492 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:20.855341 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42ac4664-f941-4242-825f-160f030aa492 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:20.855847 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-42ac4664-f941-4242-825f-160f030aa492 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:21.002334 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-93055025-83cf-4546-af6d-1f01039c8935 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:21.011355 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-93055025-83cf-4546-af6d-1f01039c8935 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1449 microversion: 2.1 time: 0.290882 Sep 14 12:25:21.012144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 694/1377] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:20 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1449 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:21.101675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-42ac4664-f941-4242-825f-160f030aa492 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:21.110328 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-42ac4664-f941-4242-825f-160f030aa492 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1748 microversion: 2.1 time: 0.270100 Sep 14 12:25:21.115501 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 684/1378] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:20 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1748 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:21.299918 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-c3da3839-fa56-45bd-b040-2649709bae76 req-5855973d-3fdc-4901-8c87-4b0b0da9944c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921553b2-7c2b-4ec6-80c9-23298af50994", "name": "network-vif-deleted", "tag": "f37c6abe-5567-400c-b0bd-04c3772b1a60"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:25:21.310186 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-c3da3839-fa56-45bd-b040-2649709bae76 req-5855973d-3fdc-4901-8c87-4b0b0da9944c service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:21.310665 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-c3da3839-fa56-45bd-b040-2649709bae76 req-5855973d-3fdc-4901-8c87-4b0b0da9944c service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:21.311098 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-c3da3839-fa56-45bd-b040-2649709bae76 req-5855973d-3fdc-4901-8c87-4b0b0da9944c service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:21.322238 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-c3da3839-fa56-45bd-b040-2649709bae76 req-5855973d-3fdc-4901-8c87-4b0b0da9944c service nova] Creating event network-vif-deleted:f37c6abe-5567-400c-b0bd-04c3772b1a60 for instance 921553b2-7c2b-4ec6-80c9-23298af50994 on hv-cinder-84496 Sep 14 12:25:21.327523 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-c3da3839-fa56-45bd-b040-2649709bae76 req-5855973d-3fdc-4901-8c87-4b0b0da9944c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031085 Sep 14 12:25:21.328133 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 695/1379] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:25:22.035457 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-529b139a-465b-430a-882c-9f7a493eca18 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:22.036084 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-529b139a-465b-430a-882c-9f7a493eca18 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:22.042022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-529b139a-465b-430a-882c-9f7a493eca18 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:22.042514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-529b139a-465b-430a-882c-9f7a493eca18 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:22.042953 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-529b139a-465b-430a-882c-9f7a493eca18 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:22.043655 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-529b139a-465b-430a-882c-9f7a493eca18 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:22.044139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-529b139a-465b-430a-882c-9f7a493eca18 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:22.044560 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-529b139a-465b-430a-882c-9f7a493eca18 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:22.106540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-529b139a-465b-430a-882c-9f7a493eca18 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:22.114698 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-529b139a-465b-430a-882c-9f7a493eca18 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1219 microversion: 2.1 time: 0.083180 Sep 14 12:25:22.115284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 685/1380] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:22 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:22.135860 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-2d520852-f61b-4a96-9c79-0b5ac2c40724 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:22.136656 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-2d520852-f61b-4a96-9c79-0b5ac2c40724 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:22.143167 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d520852-f61b-4a96-9c79-0b5ac2c40724 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:22.143654 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d520852-f61b-4a96-9c79-0b5ac2c40724 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:22.144212 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d520852-f61b-4a96-9c79-0b5ac2c40724 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:22.145154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d520852-f61b-4a96-9c79-0b5ac2c40724 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:22.145616 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d520852-f61b-4a96-9c79-0b5ac2c40724 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:22.146074 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-2d520852-f61b-4a96-9c79-0b5ac2c40724 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:22.294579 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-2d520852-f61b-4a96-9c79-0b5ac2c40724 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:22.303527 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-2d520852-f61b-4a96-9c79-0b5ac2c40724 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.172574 Sep 14 12:25:22.306101 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 696/1381] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:22 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:23.137732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:23.138383 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:23.145784 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:23.146297 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:23.146733 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:23.147429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:23.147882 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:23.148446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:23.182307 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:23.182792 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:23.183228 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:23.183675 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.objects.instance [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lazy-loading 'fault' on Instance uuid 921553b2-7c2b-4ec6-80c9-23298af50994 {{(pid=121153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:25:23.229478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b11628831fe4f50a7f9997c1f213a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9204365716924bbebdc0d90ecc13d01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:23.236515 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-30e96995-db2a-4596-9095-ee2bfeb46e76 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 200 len: 1178 microversion: 2.1 time: 0.102749 Sep 14 12:25:23.237110 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 686/1382] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:23 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 1178 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:23.327921 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d2cf9bae-6835-4500-b2b7-b76cfc1b6fc9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:23.328568 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d2cf9bae-6835-4500-b2b7-b76cfc1b6fc9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:23.335266 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2cf9bae-6835-4500-b2b7-b76cfc1b6fc9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:23.335752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2cf9bae-6835-4500-b2b7-b76cfc1b6fc9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:23.336221 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2cf9bae-6835-4500-b2b7-b76cfc1b6fc9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:23.336932 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2cf9bae-6835-4500-b2b7-b76cfc1b6fc9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:23.337387 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2cf9bae-6835-4500-b2b7-b76cfc1b6fc9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:23.337813 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d2cf9bae-6835-4500-b2b7-b76cfc1b6fc9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:23.481875 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d2cf9bae-6835-4500-b2b7-b76cfc1b6fc9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:23.491335 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d2cf9bae-6835-4500-b2b7-b76cfc1b6fc9 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.167414 Sep 14 12:25:23.491920 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 697/1383] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:23 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:24.260135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:24.260850 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] [instance: 921553b2-7c2b-4ec6-80c9-23298af50994] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:24.267516 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:24.268029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:24.268467 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:24.269197 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:24.269652 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:24.270108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:24.284849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] HTTP exception thrown: Instance 921553b2-7c2b-4ec6-80c9-23298af50994 could not be found. Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Request method failure captured: Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 HTTP/1.1 Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcaZz3wmjC4XYXFdmG53dketryczA5JMXMJUgRQnRo0mnE_8zEy550-xZxI0fDPEmo9TLgc3hh7r5WHdxSreXV3UCN7UcEjulWZfZLF_H6dC4KfloQR8S-CAC503rp6kxrJB3bVVlStTxeboGGIKOcS9gCuIsr7u91qTt4lNslY3yoY Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: 9204365716924bbebdc0d90ecc13d01e Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestShelveInstance-419398520 Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:25:24.286540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9204365716924bbebdc0d90ecc13d01e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9204365716924bbebdc0d90ecc13d01e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9204365716924bbebdc0d90ecc13d01e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9204365716924bbebdc0d90ecc13d01e"}]}] Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestShelveInstance-419398520 Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: 9204365716924bbebdc0d90ecc13d01e Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestShelveInstance-419398520 Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-TestShelveInstance-419398520-project Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 3b11628831fe4f50a7f9997c1f213a71 Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestShelveInstance-419398520-project Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 921553b2-7c2b-4ec6-80c9-23298af50994 could not be found. Sep 14 12:25:24.288353 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '921553b2-7c2b-4ec6-80c9-23298af50994'} Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921553b2-7c2b-4ec6-80c9-23298af50994 could not be found. Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:25:24.289545 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921553b2-7c2b-4ec6-80c9-23298af50994 could not be found. Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921553b2-7c2b-4ec6-80c9-23298af50994 could not be found. Sep 14 12:25:24.291562 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:25:24.293058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Returning 404 to user: Instance 921553b2-7c2b-4ec6-80c9-23298af50994 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:25:24.293058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-933eac7a-469f-4967-9c88-fb400513e056 tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994" status: 404 len: 111 microversion: 2.1 time: 0.031738 Sep 14 12:25:24.293058 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 687/1384] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:24 2022] GET /compute/v2.1/servers/921553b2-7c2b-4ec6-80c9-23298af50994 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:25:24.512387 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-85f19ba2-3574-4647-8b64-a4ffe5283d9f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] Calling method '.version_select at 0x7f1c999bdee0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:24.514633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-d835ec55-7df3-4a30-9708-fb494d8cc43e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:24.515248 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-d835ec55-7df3-4a30-9708-fb494d8cc43e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:24.525248 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d835ec55-7df3-4a30-9708-fb494d8cc43e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:24.525760 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d835ec55-7df3-4a30-9708-fb494d8cc43e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:24.526222 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d835ec55-7df3-4a30-9708-fb494d8cc43e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:24.526950 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d835ec55-7df3-4a30-9708-fb494d8cc43e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:24.527401 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d835ec55-7df3-4a30-9708-fb494d8cc43e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:24.527849 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-d835ec55-7df3-4a30-9708-fb494d8cc43e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:24.601580 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-85f19ba2-3574-4647-8b64-a4ffe5283d9f tempest-TestShelveInstance-419398520 tempest-TestShelveInstance-419398520-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1546583045" status: 202 len: 0 microversion: 2.1 time: 0.093546 Sep 14 12:25:24.602216 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 698/1385] 10.222.0.62 () {58 vars in 1254 bytes} [Wed Sep 14 12:25:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1546583045 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:25:24.681935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-d835ec55-7df3-4a30-9708-fb494d8cc43e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:24.694826 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-d835ec55-7df3-4a30-9708-fb494d8cc43e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.184078 Sep 14 12:25:24.695406 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 688/1386] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:24 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:25:25.718288 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-f7a4c5bb-c40f-48e8-8654-f62f3a588c29 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:25.718999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-f7a4c5bb-c40f-48e8-8654-f62f3a588c29 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:25.726800 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f7a4c5bb-c40f-48e8-8654-f62f3a588c29 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:25.727300 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f7a4c5bb-c40f-48e8-8654-f62f3a588c29 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:25.727758 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f7a4c5bb-c40f-48e8-8654-f62f3a588c29 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:25.728541 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f7a4c5bb-c40f-48e8-8654-f62f3a588c29 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:25.729046 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f7a4c5bb-c40f-48e8-8654-f62f3a588c29 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:25.729404 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-f7a4c5bb-c40f-48e8-8654-f62f3a588c29 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:25.897817 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-f7a4c5bb-c40f-48e8-8654-f62f3a588c29 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:25.907607 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-f7a4c5bb-c40f-48e8-8654-f62f3a588c29 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.193499 Sep 14 12:25:25.917967 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 699/1387] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:25 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:26.934826 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-78c61787-b0b5-4358-8184-1ab4bb5227ee tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:26.935486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-78c61787-b0b5-4358-8184-1ab4bb5227ee tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:26.943388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78c61787-b0b5-4358-8184-1ab4bb5227ee tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:26.944198 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78c61787-b0b5-4358-8184-1ab4bb5227ee tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:26.944647 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78c61787-b0b5-4358-8184-1ab4bb5227ee tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:26.945465 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78c61787-b0b5-4358-8184-1ab4bb5227ee tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:26.946034 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78c61787-b0b5-4358-8184-1ab4bb5227ee tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:26.946392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-78c61787-b0b5-4358-8184-1ab4bb5227ee tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:27.093999 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-78c61787-b0b5-4358-8184-1ab4bb5227ee tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:27.102291 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-78c61787-b0b5-4358-8184-1ab4bb5227ee tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.171328 Sep 14 12:25:27.102917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 689/1388] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:26 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:25:28.129247 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-9b3485a5-75ab-4c9b-8054-23dd09f33e2f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:28.130638 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-9b3485a5-75ab-4c9b-8054-23dd09f33e2f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:28.137592 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9b3485a5-75ab-4c9b-8054-23dd09f33e2f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:28.138134 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9b3485a5-75ab-4c9b-8054-23dd09f33e2f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:28.138559 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9b3485a5-75ab-4c9b-8054-23dd09f33e2f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:28.139452 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9b3485a5-75ab-4c9b-8054-23dd09f33e2f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:28.140096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9b3485a5-75ab-4c9b-8054-23dd09f33e2f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:28.140685 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-9b3485a5-75ab-4c9b-8054-23dd09f33e2f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:28.303563 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-9b3485a5-75ab-4c9b-8054-23dd09f33e2f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:28.313347 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-9b3485a5-75ab-4c9b-8054-23dd09f33e2f tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.189868 Sep 14 12:25:28.314010 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 700/1389] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:28 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:29.337534 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5834ccf9-8785-45ec-87a6-f476d05fc5ec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:29.338178 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5834ccf9-8785-45ec-87a6-f476d05fc5ec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:29.344993 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5834ccf9-8785-45ec-87a6-f476d05fc5ec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:29.345486 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5834ccf9-8785-45ec-87a6-f476d05fc5ec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:29.345956 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5834ccf9-8785-45ec-87a6-f476d05fc5ec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:29.346667 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5834ccf9-8785-45ec-87a6-f476d05fc5ec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:29.347119 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5834ccf9-8785-45ec-87a6-f476d05fc5ec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:29.347543 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5834ccf9-8785-45ec-87a6-f476d05fc5ec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:29.770866 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-5834ccf9-8785-45ec-87a6-f476d05fc5ec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:29.779528 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5834ccf9-8785-45ec-87a6-f476d05fc5ec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.445938 Sep 14 12:25:29.780122 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 690/1390] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:29 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:25:30.809087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-59702532-5c97-4c57-85c9-37d7832d59d0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:30.809726 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-59702532-5c97-4c57-85c9-37d7832d59d0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:30.818785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59702532-5c97-4c57-85c9-37d7832d59d0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:30.819571 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59702532-5c97-4c57-85c9-37d7832d59d0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:30.820313 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59702532-5c97-4c57-85c9-37d7832d59d0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:30.820931 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59702532-5c97-4c57-85c9-37d7832d59d0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:30.821422 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59702532-5c97-4c57-85c9-37d7832d59d0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:30.821849 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-59702532-5c97-4c57-85c9-37d7832d59d0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:31.076097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-59702532-5c97-4c57-85c9-37d7832d59d0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:31.085038 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-59702532-5c97-4c57-85c9-37d7832d59d0 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.285637 Sep 14 12:25:31.085737 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 701/1391] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:30 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:32.112018 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-159144ad-60a3-4998-9048-27b7a8a2d9b3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:32.113329 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-159144ad-60a3-4998-9048-27b7a8a2d9b3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:32.121062 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-159144ad-60a3-4998-9048-27b7a8a2d9b3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:32.122153 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-159144ad-60a3-4998-9048-27b7a8a2d9b3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:32.123655 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-159144ad-60a3-4998-9048-27b7a8a2d9b3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:32.124409 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-159144ad-60a3-4998-9048-27b7a8a2d9b3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:32.124877 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-159144ad-60a3-4998-9048-27b7a8a2d9b3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:32.125306 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-159144ad-60a3-4998-9048-27b7a8a2d9b3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:32.311971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-159144ad-60a3-4998-9048-27b7a8a2d9b3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:32.322354 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-159144ad-60a3-4998-9048-27b7a8a2d9b3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.215603 Sep 14 12:25:32.323903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 691/1392] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:32 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:33.348641 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-19140185-2103-4c8a-bfdc-22bcbcb7d759 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:33.349252 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-19140185-2103-4c8a-bfdc-22bcbcb7d759 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:33.356403 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19140185-2103-4c8a-bfdc-22bcbcb7d759 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:33.357107 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19140185-2103-4c8a-bfdc-22bcbcb7d759 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:33.357346 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19140185-2103-4c8a-bfdc-22bcbcb7d759 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:33.358061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19140185-2103-4c8a-bfdc-22bcbcb7d759 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:33.358519 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19140185-2103-4c8a-bfdc-22bcbcb7d759 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:33.358939 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-19140185-2103-4c8a-bfdc-22bcbcb7d759 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:33.521077 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-19140185-2103-4c8a-bfdc-22bcbcb7d759 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:33.529385 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-19140185-2103-4c8a-bfdc-22bcbcb7d759 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.184690 Sep 14 12:25:33.529986 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 702/1393] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:33 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:34.553032 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-239fa7dc-9182-4faa-8485-c00f01484889 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:34.557254 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-239fa7dc-9182-4faa-8485-c00f01484889 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:34.560100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-239fa7dc-9182-4faa-8485-c00f01484889 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:34.560641 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-239fa7dc-9182-4faa-8485-c00f01484889 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:34.561088 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-239fa7dc-9182-4faa-8485-c00f01484889 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:34.561793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-239fa7dc-9182-4faa-8485-c00f01484889 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:34.562273 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-239fa7dc-9182-4faa-8485-c00f01484889 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:34.562720 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-239fa7dc-9182-4faa-8485-c00f01484889 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:34.716423 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-239fa7dc-9182-4faa-8485-c00f01484889 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:34.725971 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-239fa7dc-9182-4faa-8485-c00f01484889 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.176978 Sep 14 12:25:34.732019 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 692/1394] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:34 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 12:25:35.750583 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8d824152-6928-4d1e-8e60-a544685204c1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:35.751187 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8d824152-6928-4d1e-8e60-a544685204c1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:35.758389 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d824152-6928-4d1e-8e60-a544685204c1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:35.758866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d824152-6928-4d1e-8e60-a544685204c1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:35.759293 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d824152-6928-4d1e-8e60-a544685204c1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:35.759977 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d824152-6928-4d1e-8e60-a544685204c1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:35.760422 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d824152-6928-4d1e-8e60-a544685204c1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:35.760837 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8d824152-6928-4d1e-8e60-a544685204c1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:35.914304 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8d824152-6928-4d1e-8e60-a544685204c1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:35.922895 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8d824152-6928-4d1e-8e60-a544685204c1 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.176114 Sep 14 12:25:35.923482 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 703/1395] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:35 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:36.949006 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-7fe0a486-0ecf-4657-af68-7a0fb76fde89 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:36.949626 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-7fe0a486-0ecf-4657-af68-7a0fb76fde89 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:36.956229 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fe0a486-0ecf-4657-af68-7a0fb76fde89 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:36.956709 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fe0a486-0ecf-4657-af68-7a0fb76fde89 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:36.957143 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fe0a486-0ecf-4657-af68-7a0fb76fde89 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:36.957845 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fe0a486-0ecf-4657-af68-7a0fb76fde89 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:36.958329 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fe0a486-0ecf-4657-af68-7a0fb76fde89 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:36.958754 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-7fe0a486-0ecf-4657-af68-7a0fb76fde89 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:37.118011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-7fe0a486-0ecf-4657-af68-7a0fb76fde89 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:37.126839 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-7fe0a486-0ecf-4657-af68-7a0fb76fde89 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1753 microversion: 2.1 time: 0.181880 Sep 14 12:25:37.127536 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 693/1396] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:36 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:25:38.151608 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-4b639296-3708-4ac9-afff-a680e3ceefce tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:25:38.152235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-4b639296-3708-4ac9-afff-a680e3ceefce tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:25:38.158845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b639296-3708-4ac9-afff-a680e3ceefce tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:38.159471 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b639296-3708-4ac9-afff-a680e3ceefce tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:38.159962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b639296-3708-4ac9-afff-a680e3ceefce tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:38.160835 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b639296-3708-4ac9-afff-a680e3ceefce tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:25:38.161296 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b639296-3708-4ac9-afff-a680e3ceefce tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:25:38.161723 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-4b639296-3708-4ac9-afff-a680e3ceefce tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:25:38.314033 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-4b639296-3708-4ac9-afff-a680e3ceefce tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:25:38.326845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-4b639296-3708-4ac9-afff-a680e3ceefce tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1756 microversion: 2.1 time: 0.178916 Sep 14 12:25:38.327909 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 704/1397] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:25:38 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:15.048029 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1291003618", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1225028685", "security_groups": [{"name": "tempest-secgroup-smoke-1914131548"}], "block_device_mapping_v2": [{"uuid": "a9eb425e-abd8-4e6f-bd36-94f5eced9ea1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7695930d-2da6-4ee9-8437-3753ca9f2e40"}]}} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:26:15.059004 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:15.059673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:15.166966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.network.neutron [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] validate_networks() for [('7695930d-2da6-4ee9-8437-3753ca9f2e40', None, None, None, None, None)] {{(pid=121153) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 12:26:15.541734 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Flavor limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 12:26:15.542199 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Image limits 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 12:26:15.542676 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Flavor pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 12:26:15.543087 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Image pref 0:0:0 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 12:26:15.543504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.virt.hardware [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 12:26:15.552182 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:15.552664 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:15.553101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:15.553826 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:15.554309 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:15.554736 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:15.571813 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Getting quotas for project e0cdab1c080d4132adc6cd64d8627c68. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 12:26:15.576389 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.quota [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Getting quotas for user 33f480ef1b8b49df83276a66f445ae85 and project e0cdab1c080d4132adc6cd64d8627c68. Resources: {'cores', 'ram', 'instances'} {{(pid=121153) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 12:26:15.633504 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Going to run 1 instances... {{(pid=121153) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 12:26:15.635694 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a9eb425e-abd8-4e6f-bd36-94f5eced9ea1',volume_size=None,volume_type=None)] {{(pid=121153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 12:26:16.097355 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2ba2cf8c-f30e-40d6-908f-2bde71ac3f00 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.053320 Sep 14 12:26:16.098365 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 694/1398] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Sep 14 12:26:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 12:26:16.109329 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-a451613a-86b5-4d94-a0b3-ac33c9dd87d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:16.109983 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-a451613a-86b5-4d94-a0b3-ac33c9dd87d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:16.113544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:16.115626 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=70 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:16.167173 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-a451613a-86b5-4d94-a0b3-ac33c9dd87d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:16.174269 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-a451613a-86b5-4d94-a0b3-ac33c9dd87d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1095 microversion: 2.1 time: 0.068830 Sep 14 12:26:16.174861 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 705/1399] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:16 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:17.198890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bf35f6ec-0368-449e-bc30-48b9146043b0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:17.199683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bf35f6ec-0368-449e-bc30-48b9146043b0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:17.251673 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bf35f6ec-0368-449e-bc30-48b9146043b0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:17.258429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bf35f6ec-0368-449e-bc30-48b9146043b0 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1095 microversion: 2.1 time: 0.064505 Sep 14 12:26:17.259003 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 695/1400] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:17 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:18.282443 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c56848f5-2a07-471b-abfb-a35f47c696d4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:18.283056 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c56848f5-2a07-471b-abfb-a35f47c696d4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:18.290821 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c56848f5-2a07-471b-abfb-a35f47c696d4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:18.291302 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c56848f5-2a07-471b-abfb-a35f47c696d4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:18.291734 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c56848f5-2a07-471b-abfb-a35f47c696d4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:18.292418 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c56848f5-2a07-471b-abfb-a35f47c696d4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:18.292867 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c56848f5-2a07-471b-abfb-a35f47c696d4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:18.293286 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c56848f5-2a07-471b-abfb-a35f47c696d4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:18.357999 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c56848f5-2a07-471b-abfb-a35f47c696d4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:18.365637 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c56848f5-2a07-471b-abfb-a35f47c696d4 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1145 microversion: 2.1 time: 0.087559 Sep 14 12:26:18.366231 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 706/1401] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:18 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:19.389039 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a164c2d3-4021-45b2-be76-20f91f9fa469 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:19.389681 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a164c2d3-4021-45b2-be76-20f91f9fa469 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:19.396631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a164c2d3-4021-45b2-be76-20f91f9fa469 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:19.397117 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a164c2d3-4021-45b2-be76-20f91f9fa469 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:19.397551 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a164c2d3-4021-45b2-be76-20f91f9fa469 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:19.398320 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a164c2d3-4021-45b2-be76-20f91f9fa469 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:19.398855 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a164c2d3-4021-45b2-be76-20f91f9fa469 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:19.402031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a164c2d3-4021-45b2-be76-20f91f9fa469 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:19.462080 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a164c2d3-4021-45b2-be76-20f91f9fa469 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:19.469802 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a164c2d3-4021-45b2-be76-20f91f9fa469 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1137 microversion: 2.1 time: 0.085375 Sep 14 12:26:19.470808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 696/1402] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:19 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:20.492581 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-5188db03-703e-4ee0-a9c5-d9f2cf5aebc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:20.493231 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-5188db03-703e-4ee0-a9c5-d9f2cf5aebc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:20.499866 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5188db03-703e-4ee0-a9c5-d9f2cf5aebc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:20.500561 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5188db03-703e-4ee0-a9c5-d9f2cf5aebc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:20.501031 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5188db03-703e-4ee0-a9c5-d9f2cf5aebc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:20.501731 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5188db03-703e-4ee0-a9c5-d9f2cf5aebc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:20.502298 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5188db03-703e-4ee0-a9c5-d9f2cf5aebc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:20.502716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-5188db03-703e-4ee0-a9c5-d9f2cf5aebc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:20.571558 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-5188db03-703e-4ee0-a9c5-d9f2cf5aebc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:20.580223 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-5188db03-703e-4ee0-a9c5-d9f2cf5aebc5 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1211 microversion: 2.1 time: 0.091598 Sep 14 12:26:20.580836 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 707/1403] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:20 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:21.606686 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-162d33b4-44f5-43ec-9a48-582b13bd70d9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:21.607312 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-162d33b4-44f5-43ec-9a48-582b13bd70d9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:21.613816 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-162d33b4-44f5-43ec-9a48-582b13bd70d9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:21.614375 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-162d33b4-44f5-43ec-9a48-582b13bd70d9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:21.615156 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-162d33b4-44f5-43ec-9a48-582b13bd70d9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:21.615873 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-162d33b4-44f5-43ec-9a48-582b13bd70d9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:21.616339 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-162d33b4-44f5-43ec-9a48-582b13bd70d9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:21.616764 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-162d33b4-44f5-43ec-9a48-582b13bd70d9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:22.088845 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-162d33b4-44f5-43ec-9a48-582b13bd70d9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:22.096592 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-162d33b4-44f5-43ec-9a48-582b13bd70d9 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1279 microversion: 2.1 time: 0.494583 Sep 14 12:26:22.097159 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 697/1404] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:21 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1279 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:22.336762 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-655c439e-2b69-4f77-904e-737f0987a399 req-d741c638-14c6-4fb7-833b-004dd6ded24b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881fc53c-9264-4ba1-ac3d-e19c3934b098", "tag": "71b95f96-2a69-42b2-83c1-cb56894b9e4b"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:26:22.358209 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-655c439e-2b69-4f77-904e-737f0987a399 req-d741c638-14c6-4fb7-833b-004dd6ded24b service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:22.359100 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-655c439e-2b69-4f77-904e-737f0987a399 req-d741c638-14c6-4fb7-833b-004dd6ded24b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:22.360649 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-655c439e-2b69-4f77-904e-737f0987a399 req-d741c638-14c6-4fb7-833b-004dd6ded24b service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:22.384542 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-655c439e-2b69-4f77-904e-737f0987a399 req-d741c638-14c6-4fb7-833b-004dd6ded24b service nova] Creating event network-changed:71b95f96-2a69-42b2-83c1-cb56894b9e4b for instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 on hv-cinder-84496 Sep 14 12:26:22.393770 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-655c439e-2b69-4f77-904e-737f0987a399 req-d741c638-14c6-4fb7-833b-004dd6ded24b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066790 Sep 14 12:26:22.399461 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 708/1405] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:26:23.119564 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-309e8345-39d3-4d30-a5f5-0401431964b1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:23.120121 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-309e8345-39d3-4d30-a5f5-0401431964b1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:23.126514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-309e8345-39d3-4d30-a5f5-0401431964b1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:23.127005 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-309e8345-39d3-4d30-a5f5-0401431964b1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:23.127440 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-309e8345-39d3-4d30-a5f5-0401431964b1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:23.128133 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-309e8345-39d3-4d30-a5f5-0401431964b1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:23.128586 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-309e8345-39d3-4d30-a5f5-0401431964b1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:23.129011 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-309e8345-39d3-4d30-a5f5-0401431964b1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:23.258749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-309e8345-39d3-4d30-a5f5-0401431964b1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:23.267310 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-309e8345-39d3-4d30-a5f5-0401431964b1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.151992 Sep 14 12:26:23.267874 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 698/1406] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:23 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:24.291248 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-969a66c6-1a00-4157-93c6-856e3a4f8ede tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:24.291978 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-969a66c6-1a00-4157-93c6-856e3a4f8ede tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:24.299948 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-969a66c6-1a00-4157-93c6-856e3a4f8ede tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:24.300504 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-969a66c6-1a00-4157-93c6-856e3a4f8ede tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:24.300967 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-969a66c6-1a00-4157-93c6-856e3a4f8ede tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:24.301668 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-969a66c6-1a00-4157-93c6-856e3a4f8ede tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:24.302154 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-969a66c6-1a00-4157-93c6-856e3a4f8ede tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:24.302585 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-969a66c6-1a00-4157-93c6-856e3a4f8ede tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:24.437158 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-969a66c6-1a00-4157-93c6-856e3a4f8ede tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:24.444785 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-969a66c6-1a00-4157-93c6-856e3a4f8ede tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.157776 Sep 14 12:26:24.445362 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 709/1407] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:24 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:25.468398 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-3589b9cd-cc7b-408b-b199-4e44fb8415f8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:25.469013 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-3589b9cd-cc7b-408b-b199-4e44fb8415f8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:25.475294 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3589b9cd-cc7b-408b-b199-4e44fb8415f8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:25.475769 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3589b9cd-cc7b-408b-b199-4e44fb8415f8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:25.476202 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3589b9cd-cc7b-408b-b199-4e44fb8415f8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:25.476879 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3589b9cd-cc7b-408b-b199-4e44fb8415f8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:25.477331 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3589b9cd-cc7b-408b-b199-4e44fb8415f8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:25.477752 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-3589b9cd-cc7b-408b-b199-4e44fb8415f8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:25.561988 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=2 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:25.610323 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-3589b9cd-cc7b-408b-b199-4e44fb8415f8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:25.617886 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-3589b9cd-cc7b-408b-b199-4e44fb8415f8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.153979 Sep 14 12:26:25.618480 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 699/1408] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:25 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:26.641212 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-e962ba5d-e037-449a-8ecc-abcf9c8ca19a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:26.641832 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-e962ba5d-e037-449a-8ecc-abcf9c8ca19a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:26.644291 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell0:SELECT=2 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:26.649014 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e962ba5d-e037-449a-8ecc-abcf9c8ca19a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:26.655694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e962ba5d-e037-449a-8ecc-abcf9c8ca19a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:26.655694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e962ba5d-e037-449a-8ecc-abcf9c8ca19a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:26.655694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e962ba5d-e037-449a-8ecc-abcf9c8ca19a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:26.655694 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e962ba5d-e037-449a-8ecc-abcf9c8ca19a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:26.656156 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-e962ba5d-e037-449a-8ecc-abcf9c8ca19a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:26.781289 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-e962ba5d-e037-449a-8ecc-abcf9c8ca19a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:26.788863 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-e962ba5d-e037-449a-8ecc-abcf9c8ca19a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.152343 Sep 14 12:26:26.789425 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 710/1409] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:26 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:27.811271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-dab8b3f0-430f-47f1-8f21-a41e3748ca9f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:27.812042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-dab8b3f0-430f-47f1-8f21-a41e3748ca9f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:27.814214 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell0:SELECT=8 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:27.819085 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dab8b3f0-430f-47f1-8f21-a41e3748ca9f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:27.819577 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dab8b3f0-430f-47f1-8f21-a41e3748ca9f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:27.824185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dab8b3f0-430f-47f1-8f21-a41e3748ca9f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:27.824185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dab8b3f0-430f-47f1-8f21-a41e3748ca9f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:27.824185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dab8b3f0-430f-47f1-8f21-a41e3748ca9f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:27.824185 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-dab8b3f0-430f-47f1-8f21-a41e3748ca9f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:27.967732 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-dab8b3f0-430f-47f1-8f21-a41e3748ca9f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:27.975496 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-dab8b3f0-430f-47f1-8f21-a41e3748ca9f tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.168231 Sep 14 12:26:27.976077 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 700/1410] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:27 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:28.998076 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c8f581b7-7618-4d4b-a3cb-49c5d5aca097 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:28.998684 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c8f581b7-7618-4d4b-a3cb-49c5d5aca097 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:29.005062 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8f581b7-7618-4d4b-a3cb-49c5d5aca097 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:29.005538 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8f581b7-7618-4d4b-a3cb-49c5d5aca097 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:29.005996 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8f581b7-7618-4d4b-a3cb-49c5d5aca097 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:29.006674 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8f581b7-7618-4d4b-a3cb-49c5d5aca097 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:29.007118 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8f581b7-7618-4d4b-a3cb-49c5d5aca097 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:29.007533 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c8f581b7-7618-4d4b-a3cb-49c5d5aca097 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:29.134791 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c8f581b7-7618-4d4b-a3cb-49c5d5aca097 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:29.143109 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c8f581b7-7618-4d4b-a3cb-49c5d5aca097 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.149009 Sep 14 12:26:29.143678 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 711/1411] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:28 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:30.166351 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-acb19ae7-bf8b-4d5a-9a09-868a2a968441 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:30.166973 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-acb19ae7-bf8b-4d5a-9a09-868a2a968441 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:30.174069 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb19ae7-bf8b-4d5a-9a09-868a2a968441 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:30.174559 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb19ae7-bf8b-4d5a-9a09-868a2a968441 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:30.175003 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb19ae7-bf8b-4d5a-9a09-868a2a968441 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:30.175699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb19ae7-bf8b-4d5a-9a09-868a2a968441 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:30.176162 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb19ae7-bf8b-4d5a-9a09-868a2a968441 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:30.176587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-acb19ae7-bf8b-4d5a-9a09-868a2a968441 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:30.310814 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-acb19ae7-bf8b-4d5a-9a09-868a2a968441 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:30.318416 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-acb19ae7-bf8b-4d5a-9a09-868a2a968441 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.156128 Sep 14 12:26:30.318988 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 701/1412] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:30 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:31.341971 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-18200925-d8ce-499c-aa84-76f5595e4102 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:31.342586 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-18200925-d8ce-499c-aa84-76f5595e4102 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:31.349013 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18200925-d8ce-499c-aa84-76f5595e4102 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:31.349500 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18200925-d8ce-499c-aa84-76f5595e4102 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:31.350061 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18200925-d8ce-499c-aa84-76f5595e4102 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:31.350752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18200925-d8ce-499c-aa84-76f5595e4102 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:31.351206 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18200925-d8ce-499c-aa84-76f5595e4102 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:31.351629 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-18200925-d8ce-499c-aa84-76f5595e4102 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:31.480812 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-18200925-d8ce-499c-aa84-76f5595e4102 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:31.488363 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-18200925-d8ce-499c-aa84-76f5595e4102 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.150893 Sep 14 12:26:31.488929 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 712/1413] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:31 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:32.510699 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-2ec41eef-15d1-4d1d-b3af-42fb97b8053e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:32.511255 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-2ec41eef-15d1-4d1d-b3af-42fb97b8053e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:32.517897 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ec41eef-15d1-4d1d-b3af-42fb97b8053e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:32.518377 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ec41eef-15d1-4d1d-b3af-42fb97b8053e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:32.518810 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ec41eef-15d1-4d1d-b3af-42fb97b8053e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:32.519489 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ec41eef-15d1-4d1d-b3af-42fb97b8053e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:32.519937 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ec41eef-15d1-4d1d-b3af-42fb97b8053e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:32.520358 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-2ec41eef-15d1-4d1d-b3af-42fb97b8053e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:32.651701 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-2ec41eef-15d1-4d1d-b3af-42fb97b8053e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:32.659793 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-2ec41eef-15d1-4d1d-b3af-42fb97b8053e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.153024 Sep 14 12:26:32.660357 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 702/1414] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:32 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:33.683082 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-abe4e1cc-9307-4fb8-aa2a-bc25dfbe423e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:33.683696 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-abe4e1cc-9307-4fb8-aa2a-bc25dfbe423e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:33.690918 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-abe4e1cc-9307-4fb8-aa2a-bc25dfbe423e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:33.691408 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-abe4e1cc-9307-4fb8-aa2a-bc25dfbe423e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:33.691849 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-abe4e1cc-9307-4fb8-aa2a-bc25dfbe423e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:33.692564 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-abe4e1cc-9307-4fb8-aa2a-bc25dfbe423e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:33.693012 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-abe4e1cc-9307-4fb8-aa2a-bc25dfbe423e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:33.693440 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-abe4e1cc-9307-4fb8-aa2a-bc25dfbe423e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:33.828757 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-abe4e1cc-9307-4fb8-aa2a-bc25dfbe423e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:33.837098 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-abe4e1cc-9307-4fb8-aa2a-bc25dfbe423e tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.157887 Sep 14 12:26:33.837675 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 713/1415] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:33 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:34.860077 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a06b0372-a079-41b8-8bb3-9db36dc6a9a8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:34.860697 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a06b0372-a079-41b8-8bb3-9db36dc6a9a8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:34.867100 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a06b0372-a079-41b8-8bb3-9db36dc6a9a8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:34.867591 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a06b0372-a079-41b8-8bb3-9db36dc6a9a8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:34.868120 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a06b0372-a079-41b8-8bb3-9db36dc6a9a8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:34.868819 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a06b0372-a079-41b8-8bb3-9db36dc6a9a8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:34.869301 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a06b0372-a079-41b8-8bb3-9db36dc6a9a8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:34.869731 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a06b0372-a079-41b8-8bb3-9db36dc6a9a8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:35.000512 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a06b0372-a079-41b8-8bb3-9db36dc6a9a8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:35.008306 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a06b0372-a079-41b8-8bb3-9db36dc6a9a8 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.152073 Sep 14 12:26:35.008890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 703/1416] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:34 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:35.679877 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-e96b49a9-9791-490f-9c73-3075b3afdd96 req-72574bb8-8f96-4808-9879-8b1004347785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881fc53c-9264-4ba1-ac3d-e19c3934b098", "name": "network-vif-plugged", "status": "completed", "tag": "71b95f96-2a69-42b2-83c1-cb56894b9e4b"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:26:35.689876 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-e96b49a9-9791-490f-9c73-3075b3afdd96 req-72574bb8-8f96-4808-9879-8b1004347785 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:35.693475 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-e96b49a9-9791-490f-9c73-3075b3afdd96 req-72574bb8-8f96-4808-9879-8b1004347785 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:35.693475 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-e96b49a9-9791-490f-9c73-3075b3afdd96 req-72574bb8-8f96-4808-9879-8b1004347785 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:35.704181 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-e96b49a9-9791-490f-9c73-3075b3afdd96 req-72574bb8-8f96-4808-9879-8b1004347785 service nova] Creating event network-vif-plugged:71b95f96-2a69-42b2-83c1-cb56894b9e4b for instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 on hv-cinder-84496 Sep 14 12:26:35.709204 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-e96b49a9-9791-490f-9c73-3075b3afdd96 req-72574bb8-8f96-4808-9879-8b1004347785 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033012 Sep 14 12:26:35.709810 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 714/1417] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:26:36.032017 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-768158bd-7b78-4e8a-a973-8dffff944a99 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:36.032577 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-768158bd-7b78-4e8a-a973-8dffff944a99 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:36.039067 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-768158bd-7b78-4e8a-a973-8dffff944a99 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:36.039552 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-768158bd-7b78-4e8a-a973-8dffff944a99 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:36.039987 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-768158bd-7b78-4e8a-a973-8dffff944a99 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:36.040676 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-768158bd-7b78-4e8a-a973-8dffff944a99 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:36.041176 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-768158bd-7b78-4e8a-a973-8dffff944a99 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:36.041600 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-768158bd-7b78-4e8a-a973-8dffff944a99 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:36.219475 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-768158bd-7b78-4e8a-a973-8dffff944a99 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:36.226542 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-768158bd-7b78-4e8a-a973-8dffff944a99 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.199227 Sep 14 12:26:36.241995 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 704/1418] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:36 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:37.251252 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-6edf5ff8-2829-411f-8de3-30f570c4ed06 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:37.251990 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-6edf5ff8-2829-411f-8de3-30f570c4ed06 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:37.258260 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6edf5ff8-2829-411f-8de3-30f570c4ed06 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:37.258737 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6edf5ff8-2829-411f-8de3-30f570c4ed06 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:37.259236 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6edf5ff8-2829-411f-8de3-30f570c4ed06 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:37.259884 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6edf5ff8-2829-411f-8de3-30f570c4ed06 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:37.260332 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6edf5ff8-2829-411f-8de3-30f570c4ed06 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:37.260760 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-6edf5ff8-2829-411f-8de3-30f570c4ed06 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:37.394686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-6edf5ff8-2829-411f-8de3-30f570c4ed06 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:37.402294 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-6edf5ff8-2829-411f-8de3-30f570c4ed06 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1267 microversion: 2.1 time: 0.156452 Sep 14 12:26:37.402886 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 715/1419] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:37 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:38.425473 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-a14f6681-e939-407c-9d64-d11c9fd45a33 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:38.426108 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-a14f6681-e939-407c-9d64-d11c9fd45a33 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:38.432540 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a14f6681-e939-407c-9d64-d11c9fd45a33 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:38.433045 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a14f6681-e939-407c-9d64-d11c9fd45a33 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:38.433572 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a14f6681-e939-407c-9d64-d11c9fd45a33 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:38.434238 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a14f6681-e939-407c-9d64-d11c9fd45a33 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:38.434686 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a14f6681-e939-407c-9d64-d11c9fd45a33 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:38.435115 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-a14f6681-e939-407c-9d64-d11c9fd45a33 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:38.580375 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-a14f6681-e939-407c-9d64-d11c9fd45a33 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:38.588284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-a14f6681-e939-407c-9d64-d11c9fd45a33 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1454 microversion: 2.1 time: 0.166766 Sep 14 12:26:38.588868 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 705/1420] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:38 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:38.610525 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-99d04a33-a9ad-4253-96a2-e33156bb218a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:38.611125 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-99d04a33-a9ad-4253-96a2-e33156bb218a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:38.617681 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99d04a33-a9ad-4253-96a2-e33156bb218a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:38.618214 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99d04a33-a9ad-4253-96a2-e33156bb218a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:38.619481 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99d04a33-a9ad-4253-96a2-e33156bb218a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:38.619481 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99d04a33-a9ad-4253-96a2-e33156bb218a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:38.619942 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99d04a33-a9ad-4253-96a2-e33156bb218a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:38.620361 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-99d04a33-a9ad-4253-96a2-e33156bb218a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:38.751513 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-99d04a33-a9ad-4253-96a2-e33156bb218a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:26:38.759215 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-99d04a33-a9ad-4253-96a2-e33156bb218a tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1454 microversion: 2.1 time: 0.152527 Sep 14 12:26:38.759776 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 716/1421] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:26:38 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:26:41.065468 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-006cc3da-28b9-41de-8a38-4edfc7b1b1af req-1217601e-4ce1-4082-a82d-0ffbb85fc6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881fc53c-9264-4ba1-ac3d-e19c3934b098", "tag": "71b95f96-2a69-42b2-83c1-cb56894b9e4b"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:26:41.074221 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-006cc3da-28b9-41de-8a38-4edfc7b1b1af req-1217601e-4ce1-4082-a82d-0ffbb85fc6a0 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:41.074703 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-006cc3da-28b9-41de-8a38-4edfc7b1b1af req-1217601e-4ce1-4082-a82d-0ffbb85fc6a0 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:41.075135 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-006cc3da-28b9-41de-8a38-4edfc7b1b1af req-1217601e-4ce1-4082-a82d-0ffbb85fc6a0 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:41.086935 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-006cc3da-28b9-41de-8a38-4edfc7b1b1af req-1217601e-4ce1-4082-a82d-0ffbb85fc6a0 service nova] Creating event network-changed:71b95f96-2a69-42b2-83c1-cb56894b9e4b for instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 on hv-cinder-84496 Sep 14 12:26:41.093130 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-006cc3da-28b9-41de-8a38-4edfc7b1b1af req-1217601e-4ce1-4082-a82d-0ffbb85fc6a0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179412 Sep 14 12:26:41.095160 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 706/1422] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:26:55.606250 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-923efde5-aead-439c-bde7-ff88452b771e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-72683924"}} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:26:55.606926 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-923efde5-aead-439c-bde7-ff88452b771e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:55.609141 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=26 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:55.609806 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=58 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:55.614683 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-923efde5-aead-439c-bde7-ff88452b771e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:55.615170 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-923efde5-aead-439c-bde7-ff88452b771e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:55.615606 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-923efde5-aead-439c-bde7-ff88452b771e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:55.616288 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-923efde5-aead-439c-bde7-ff88452b771e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:55.616737 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-923efde5-aead-439c-bde7-ff88452b771e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:55.617470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-923efde5-aead-439c-bde7-ff88452b771e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:55.808444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.network.security_group_api [None req-923efde5-aead-439c-bde7-ff88452b771e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Removing security group 6e4ab867-58af-48e3-ab45-f32119a6f2ee from port d0116994-2eb1-4246-a0d6-2ce571474c5c Sep 14 12:26:56.157558 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-923efde5-aead-439c-bde7-ff88452b771e tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "POST /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/action" status: 202 len: 0 microversion: 2.1 time: 0.555278 Sep 14 12:26:56.158370 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 717/1423] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Sep 14 12:26:55 2022] POST /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:26:56.174362 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:56.176031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=64 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:26:56.186452 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-76adfe54-f34c-4ccb-b840-d0da26605e03 req-a37575dc-968b-40cd-93e8-0dc449c15518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317a118f-cac5-4462-9a96-2292223af807", "tag": "d0116994-2eb1-4246-a0d6-2ce571474c5c"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:26:56.209224 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-76adfe54-f34c-4ccb-b840-d0da26605e03 req-a37575dc-968b-40cd-93e8-0dc449c15518 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:56.210482 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-76adfe54-f34c-4ccb-b840-d0da26605e03 req-a37575dc-968b-40cd-93e8-0dc449c15518 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:56.211593 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-76adfe54-f34c-4ccb-b840-d0da26605e03 req-a37575dc-968b-40cd-93e8-0dc449c15518 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:56.236261 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-76adfe54-f34c-4ccb-b840-d0da26605e03 req-a37575dc-968b-40cd-93e8-0dc449c15518 service nova] Creating event network-changed:d0116994-2eb1-4246-a0d6-2ce571474c5c for instance 317a118f-cac5-4462-9a96-2292223af807 on hv-cinder-84496 Sep 14 12:26:56.248904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-76adfe54-f34c-4ccb-b840-d0da26605e03 req-a37575dc-968b-40cd-93e8-0dc449c15518 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082500 Sep 14 12:26:56.250166 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 707/1424] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:26:57.360042 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-ca0818b3-c83c-4bf6-9de0-e5cb999bc507 req-791c27e0-060c-44a5-b56b-c4f467d11cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317a118f-cac5-4462-9a96-2292223af807", "tag": "d0116994-2eb1-4246-a0d6-2ce571474c5c"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:26:57.366802 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-625b5810-78e0-46ca-8a12-392e8c1e9de3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:57.367301 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-625b5810-78e0-46ca-8a12-392e8c1e9de3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:57.374000 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625b5810-78e0-46ca-8a12-392e8c1e9de3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:57.374494 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625b5810-78e0-46ca-8a12-392e8c1e9de3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:57.374924 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625b5810-78e0-46ca-8a12-392e8c1e9de3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:57.375856 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625b5810-78e0-46ca-8a12-392e8c1e9de3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:57.376308 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625b5810-78e0-46ca-8a12-392e8c1e9de3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:57.376561 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ca0818b3-c83c-4bf6-9de0-e5cb999bc507 req-791c27e0-060c-44a5-b56b-c4f467d11cf3 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:57.376727 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-625b5810-78e0-46ca-8a12-392e8c1e9de3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:57.377037 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ca0818b3-c83c-4bf6-9de0-e5cb999bc507 req-791c27e0-060c-44a5-b56b-c4f467d11cf3 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:57.377661 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-ca0818b3-c83c-4bf6-9de0-e5cb999bc507 req-791c27e0-060c-44a5-b56b-c4f467d11cf3 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:57.390284 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-ca0818b3-c83c-4bf6-9de0-e5cb999bc507 req-791c27e0-060c-44a5-b56b-c4f467d11cf3 service nova] Creating event network-changed:d0116994-2eb1-4246-a0d6-2ce571474c5c for instance 317a118f-cac5-4462-9a96-2292223af807 on hv-cinder-84496 Sep 14 12:26:57.395435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-ca0818b3-c83c-4bf6-9de0-e5cb999bc507 req-791c27e0-060c-44a5-b56b-c4f467d11cf3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040341 Sep 14 12:26:57.396049 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 708/1425] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:26:57.461122 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-625b5810-78e0-46ca-8a12-392e8c1e9de3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lazy-loading 'services' on Instance uuid 317a118f-cac5-4462-9a96-2292223af807 {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:26:57.644325 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-625b5810-78e0-46ca-8a12-392e8c1e9de3 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "DELETE /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments/79ced0bc-a378-458b-94f2-145044664be1" status: 202 len: 0 microversion: 2.1 time: 0.292254 Sep 14 12:26:57.645148 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 718/1426] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:26:57 2022] DELETE /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments/79ced0bc-a378-458b-94f2-145044664be1 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 12:26:57.654270 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1a7d68a8-84ee-4b8a-a245-7f382f618ba7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:57.657126 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1a7d68a8-84ee-4b8a-a245-7f382f618ba7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:57.663937 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a7d68a8-84ee-4b8a-a245-7f382f618ba7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:57.664434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a7d68a8-84ee-4b8a-a245-7f382f618ba7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:57.664964 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a7d68a8-84ee-4b8a-a245-7f382f618ba7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:57.665706 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a7d68a8-84ee-4b8a-a245-7f382f618ba7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:57.666188 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a7d68a8-84ee-4b8a-a245-7f382f618ba7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:57.673553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1a7d68a8-84ee-4b8a-a245-7f382f618ba7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:57.703111 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1a7d68a8-84ee-4b8a-a245-7f382f618ba7 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053297 Sep 14 12:26:57.707994 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 709/1427] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:26:57 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:26:58.713097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 12:26:58.713679 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Wed Sep 14 12:26:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments (ip 10.222.0.62) !!! Sep 14 12:26:58.719020 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7cd856e1-21d4-4bd4-8479-9652e1367e17 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:58.721413 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-7cd856e1-21d4-4bd4-8479-9652e1367e17 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:58.729112 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7cd856e1-21d4-4bd4-8479-9652e1367e17 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:58.729617 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7cd856e1-21d4-4bd4-8479-9652e1367e17 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:58.730079 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7cd856e1-21d4-4bd4-8479-9652e1367e17 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:58.730777 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7cd856e1-21d4-4bd4-8479-9652e1367e17 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:58.731235 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7cd856e1-21d4-4bd4-8479-9652e1367e17 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:58.731661 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-7cd856e1-21d4-4bd4-8479-9652e1367e17 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:58.763179 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7cd856e1-21d4-4bd4-8479-9652e1367e17 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050982 Sep 14 12:26:58.763766 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 719/1428] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:26:58 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:26:59.776938 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-de0bccfd-dd13-4c2f-9a19-7e06ba2a5ddd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:59.779209 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-de0bccfd-dd13-4c2f-9a19-7e06ba2a5ddd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:59.781478 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 12:26:59.781653 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Wed Sep 14 12:26:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments (ip 10.222.0.62) !!! Sep 14 12:26:59.794434 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de0bccfd-dd13-4c2f-9a19-7e06ba2a5ddd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:59.794964 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de0bccfd-dd13-4c2f-9a19-7e06ba2a5ddd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:59.795404 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de0bccfd-dd13-4c2f-9a19-7e06ba2a5ddd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:59.796109 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de0bccfd-dd13-4c2f-9a19-7e06ba2a5ddd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:59.796595 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de0bccfd-dd13-4c2f-9a19-7e06ba2a5ddd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:59.797025 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-de0bccfd-dd13-4c2f-9a19-7e06ba2a5ddd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:59.827318 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-de0bccfd-dd13-4c2f-9a19-7e06ba2a5ddd tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053679 Sep 14 12:26:59.827895 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 710/1429] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Sep 14 12:26:59 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 12:26:59.839419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:26:59.839419 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:26:59.848087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:59.848757 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:59.849315 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:59.850054 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:26:59.850516 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:26:59.850943 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:26:59.926113 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] HTTP exception thrown: Instance 317a118f-cac5-4462-9a96-2292223af807 is not attached to volume 79ced0bc-a378-458b-94f2-145044664be1 Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Request method failure captured: Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments/79ced0bc-a378-458b-94f2-145044664be1 HTTP/1.1 Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIceYkByh22c6qKKPlStXnNGd16e-Br8swlwkOwIgz027Zz8pBRa9HN1oZoN6Bn4YLnAeqtuC06nJkN9sFIz_WxyQIvxyHyC4Fc9SqCPXYRHuFeILoj6glOM_bG6sc8Gr5ckMljlQ8yhAH9m9zIQasKXHWIp9vlt3lmCdMkPjrUgsv1s Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: b9a967a1f3444a1e8b7f4321722b5949 Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-TestMinimumBasicScenario-136131139 Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:26:59.928622 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b9a967a1f3444a1e8b7f4321722b5949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b9a967a1f3444a1e8b7f4321722b5949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b9a967a1f3444a1e8b7f4321722b5949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b9a967a1f3444a1e8b7f4321722b5949"}]}] Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-TestMinimumBasicScenario-136131139 Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: b9a967a1f3444a1e8b7f4321722b5949 Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-TestMinimumBasicScenario-136131139 Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-TestMinimumBasicScenario-136131139-project Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 6e9703bf61d14dc4ac52a7c50fb8390e Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-TestMinimumBasicScenario-136131139-project Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:26:59.930560 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 317a118f-cac5-4462-9a96-2292223af807 is not attached to volume 79ced0bc-a378-458b-94f2-145044664be1 Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'server_id': '317a118f-cac5-4462-9a96-2292223af807', 'id': '79ced0bc-a378-458b-94f2-145044664be1'} Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 79ced0bc-a378-458b-94f2-145044664be1. Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:26:59.931589 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317a118f-cac5-4462-9a96-2292223af807 is not attached to volume 79ced0bc-a378-458b-94f2-145044664be1 Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317a118f-cac5-4462-9a96-2292223af807 is not attached to volume 79ced0bc-a378-458b-94f2-145044664be1 Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:26:59.933253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Returning 404 to user: Instance 317a118f-cac5-4462-9a96-2292223af807 is not attached to volume 79ced0bc-a378-458b-94f2-145044664be1 {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:26:59.934701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-b1ce5abf-f31e-46e3-a2ea-3b4dc9f4989d tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "DELETE /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments/79ced0bc-a378-458b-94f2-145044664be1" status: 404 len: 154 microversion: 2.1 time: 0.094955 Sep 14 12:26:59.934701 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 720/1430] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Sep 14 12:26:59 2022] DELETE /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807/os-volume_attachments/79ced0bc-a378-458b-94f2-145044664be1 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:27:01.193460 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-ba3fc837-cb4c-4d76-b6af-745a40001e39 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:27:01.194188 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ba3fc837-cb4c-4d76-b6af-745a40001e39 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:27:01.200473 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3fc837-cb4c-4d76-b6af-745a40001e39 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:01.200960 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3fc837-cb4c-4d76-b6af-745a40001e39 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:01.201407 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3fc837-cb4c-4d76-b6af-745a40001e39 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:01.202121 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3fc837-cb4c-4d76-b6af-745a40001e39 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:01.202576 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3fc837-cb4c-4d76-b6af-745a40001e39 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:01.203010 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-ba3fc837-cb4c-4d76-b6af-745a40001e39 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:01.230240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-ba3fc837-cb4c-4d76-b6af-745a40001e39 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:27:01.527392 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-ba3fc837-cb4c-4d76-b6af-745a40001e39 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "DELETE /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 204 len: 0 microversion: 2.1 time: 0.337293 Sep 14 12:27:01.527880 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 711/1431] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:27:01 2022] DELETE /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:27:01.536761 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-bd8837db-4866-4177-9672-63a5a83b11e2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:27:01.537544 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-bd8837db-4866-4177-9672-63a5a83b11e2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:27:01.544053 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bd8837db-4866-4177-9672-63a5a83b11e2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:01.544535 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bd8837db-4866-4177-9672-63a5a83b11e2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:01.544972 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bd8837db-4866-4177-9672-63a5a83b11e2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:01.545704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bd8837db-4866-4177-9672-63a5a83b11e2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:01.546196 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bd8837db-4866-4177-9672-63a5a83b11e2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:01.549988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-bd8837db-4866-4177-9672-63a5a83b11e2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:01.678342 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-bd8837db-4866-4177-9672-63a5a83b11e2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:27:01.686686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-bd8837db-4866-4177-9672-63a5a83b11e2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1553 microversion: 2.1 time: 0.153228 Sep 14 12:27:01.687267 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 721/1432] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:27:01 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:27:02.722712 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-1f3fe426-b086-43c2-aa20-e6b7fbb4acec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:27:02.722712 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-1f3fe426-b086-43c2-aa20-e6b7fbb4acec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:27:02.722712 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f3fe426-b086-43c2-aa20-e6b7fbb4acec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:02.722712 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f3fe426-b086-43c2-aa20-e6b7fbb4acec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:02.723581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f3fe426-b086-43c2-aa20-e6b7fbb4acec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:02.723581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f3fe426-b086-43c2-aa20-e6b7fbb4acec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:02.723581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f3fe426-b086-43c2-aa20-e6b7fbb4acec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:02.723581 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-1f3fe426-b086-43c2-aa20-e6b7fbb4acec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:02.906624 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-1f3fe426-b086-43c2-aa20-e6b7fbb4acec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:27:02.914959 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-1f3fe426-b086-43c2-aa20-e6b7fbb4acec tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1553 microversion: 2.1 time: 0.208078 Sep 14 12:27:02.915587 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 712/1433] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:27:02 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:27:03.938845 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-81b8c8e0-ee29-4b43-9b4b-be24731a16ac tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:27:03.939688 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-81b8c8e0-ee29-4b43-9b4b-be24731a16ac tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:27:03.946913 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81b8c8e0-ee29-4b43-9b4b-be24731a16ac tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:03.949621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81b8c8e0-ee29-4b43-9b4b-be24731a16ac tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:03.949621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81b8c8e0-ee29-4b43-9b4b-be24731a16ac tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:03.949621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81b8c8e0-ee29-4b43-9b4b-be24731a16ac tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:03.949621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81b8c8e0-ee29-4b43-9b4b-be24731a16ac tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:03.950110 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-81b8c8e0-ee29-4b43-9b4b-be24731a16ac tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:04.083876 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-81b8c8e0-ee29-4b43-9b4b-be24731a16ac tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:27:04.091819 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-81b8c8e0-ee29-4b43-9b4b-be24731a16ac tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1553 microversion: 2.1 time: 0.156893 Sep 14 12:27:04.092408 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 722/1434] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:27:03 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:27:04.944158 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-15f5f9f8-af3f-45fc-95d7-670d19756a5f req-485aa7e3-82f7-4ab5-8b43-a6714808b549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317a118f-cac5-4462-9a96-2292223af807", "name": "network-vif-deleted", "tag": "d0116994-2eb1-4246-a0d6-2ce571474c5c"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:27:04.954578 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-15f5f9f8-af3f-45fc-95d7-670d19756a5f req-485aa7e3-82f7-4ab5-8b43-a6714808b549 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:04.955057 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-15f5f9f8-af3f-45fc-95d7-670d19756a5f req-485aa7e3-82f7-4ab5-8b43-a6714808b549 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:04.955490 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-15f5f9f8-af3f-45fc-95d7-670d19756a5f req-485aa7e3-82f7-4ab5-8b43-a6714808b549 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:04.966744 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-15f5f9f8-af3f-45fc-95d7-670d19756a5f req-485aa7e3-82f7-4ab5-8b43-a6714808b549 service nova] Creating event network-vif-deleted:d0116994-2eb1-4246-a0d6-2ce571474c5c for instance 317a118f-cac5-4462-9a96-2292223af807 on hv-cinder-84496 Sep 14 12:27:04.972277 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-15f5f9f8-af3f-45fc-95d7-670d19756a5f req-485aa7e3-82f7-4ab5-8b43-a6714808b549 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032569 Sep 14 12:27:04.973132 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 713/1435] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:27:05.115469 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-8cdd08b9-12f0-445c-b7b3-cceed008d666 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:27:05.116075 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-8cdd08b9-12f0-445c-b7b3-cceed008d666 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:27:05.122619 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8cdd08b9-12f0-445c-b7b3-cceed008d666 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:05.123123 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8cdd08b9-12f0-445c-b7b3-cceed008d666 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:05.124221 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8cdd08b9-12f0-445c-b7b3-cceed008d666 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:05.124985 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8cdd08b9-12f0-445c-b7b3-cceed008d666 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:05.125456 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8cdd08b9-12f0-445c-b7b3-cceed008d666 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:05.125915 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-8cdd08b9-12f0-445c-b7b3-cceed008d666 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:05.190834 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-8cdd08b9-12f0-445c-b7b3-cceed008d666 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9703bf61d14dc4ac52a7c50fb8390e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a967a1f3444a1e8b7f4321722b5949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:27:05.198473 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-8cdd08b9-12f0-445c-b7b3-cceed008d666 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 200 len: 1343 microversion: 2.1 time: 0.086985 Sep 14 12:27:05.203716 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 723/1436] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:27:05 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 1343 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:27:06.222553 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:27:06.223152 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] [instance: 317a118f-cac5-4462-9a96-2292223af807] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:27:06.229904 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:06.230389 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:06.230822 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:06.231509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:27:06.231956 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:27:06.232381 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:27:06.246083 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] HTTP exception thrown: Instance 317a118f-cac5-4462-9a96-2292223af807 could not be found. Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Request method failure captured: Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 HTTP/1.1 Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIceYkByh22c6qKKPlStXnNGd16e-Br8swlwkOwIgz027Zz8pBRa9HN1oZoN6Bn4YLnAeqtuC06nJkN9sFIz_WxyQIvxyHyC4Fc9SqCPXYRHuFeILoj6glOM_bG6sc8Gr5ckMljlQ8yhAH9m9zIQasKXHWIp9vlt3lmCdMkPjrUgsv1s Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: b9a967a1f3444a1e8b7f4321722b5949 Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestMinimumBasicScenario-136131139 Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:27:06.247723 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b9a967a1f3444a1e8b7f4321722b5949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b9a967a1f3444a1e8b7f4321722b5949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b9a967a1f3444a1e8b7f4321722b5949"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b9a967a1f3444a1e8b7f4321722b5949"}]}] Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestMinimumBasicScenario-136131139 Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: b9a967a1f3444a1e8b7f4321722b5949 Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestMinimumBasicScenario-136131139 Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-TestMinimumBasicScenario-136131139-project Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 6e9703bf61d14dc4ac52a7c50fb8390e Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestMinimumBasicScenario-136131139-project Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 317a118f-cac5-4462-9a96-2292223af807 could not be found. Sep 14 12:27:06.249620 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '317a118f-cac5-4462-9a96-2292223af807'} Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317a118f-cac5-4462-9a96-2292223af807 could not be found. Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:27:06.252073 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317a118f-cac5-4462-9a96-2292223af807 could not be found. Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317a118f-cac5-4462-9a96-2292223af807 could not be found. Sep 14 12:27:06.253683 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:27:06.259319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Returning 404 to user: Instance 317a118f-cac5-4462-9a96-2292223af807 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:27:06.259319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-9c045cd7-f1e9-4339-b1ce-176b57864f80 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807" status: 404 len: 111 microversion: 2.1 time: 0.031184 Sep 14 12:27:06.259319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 714/1437] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:27:06 2022] GET /compute/v2.1/servers/317a118f-cac5-4462-9a96-2292223af807 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:27:06.259621 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-7482781f-46d2-4a41-9d08-0c02348176f2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] Calling method '.version_select at 0x7f1c99997160>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:27:06.335366 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-7482781f-46d2-4a41-9d08-0c02348176f2 tempest-TestMinimumBasicScenario-136131139 tempest-TestMinimumBasicScenario-136131139-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2027457668" status: 202 len: 0 microversion: 2.1 time: 0.080312 Sep 14 12:27:06.335952 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 724/1438] 10.222.0.62 () {58 vars in 1272 bytes} [Wed Sep 14 12:27:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2027457668 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 12:28:44.621978 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:28:44.622917 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG dbcounter [-] [121153] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:28:44.624500 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:28:44.624966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 12:28:44.624966 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Wed Sep 14 12:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 (ip 10.222.0.62) !!! Sep 14 12:28:44.626374 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG dbcounter [-] [121152] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=121152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:28:44.630538 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-256766d8-8955-4bc3-915a-15c85dab051c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:44.632395 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-256766d8-8955-4bc3-915a-15c85dab051c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:44.632538 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [req-db7aa375-3cfa-4be1-b349-8c45d15f0fda req-c33d69a4-06f3-4446-9881-a4fdd425bce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881fc53c-9264-4ba1-ac3d-e19c3934b098", "tag": "71b95f96-2a69-42b2-83c1-cb56894b9e4b"}]} {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:28:44.643086 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-db7aa375-3cfa-4be1-b349-8c45d15f0fda req-c33d69a4-06f3-4446-9881-a4fdd425bce5 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:44.643561 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-db7aa375-3cfa-4be1-b349-8c45d15f0fda req-c33d69a4-06f3-4446-9881-a4fdd425bce5 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:44.644205 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [req-db7aa375-3cfa-4be1-b349-8c45d15f0fda req-c33d69a4-06f3-4446-9881-a4fdd425bce5 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:44.645237 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256766d8-8955-4bc3-915a-15c85dab051c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:44.645733 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256766d8-8955-4bc3-915a-15c85dab051c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:44.646388 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256766d8-8955-4bc3-915a-15c85dab051c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:44.647099 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256766d8-8955-4bc3-915a-15c85dab051c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:44.647556 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256766d8-8955-4bc3-915a-15c85dab051c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:44.647984 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-256766d8-8955-4bc3-915a-15c85dab051c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:44.655872 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.compute.server_external_events [req-db7aa375-3cfa-4be1-b349-8c45d15f0fda req-c33d69a4-06f3-4446-9881-a4fdd425bce5 service nova] Creating event network-changed:71b95f96-2a69-42b2-83c1-cb56894b9e4b for instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 on hv-cinder-84496 Sep 14 12:28:44.661646 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [req-db7aa375-3cfa-4be1-b349-8c45d15f0fda req-c33d69a4-06f3-4446-9881-a4fdd425bce5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039483 Sep 14 12:28:44.662470 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 725/1439] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:28:44.678125 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-256766d8-8955-4bc3-915a-15c85dab051c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Going to try to terminate instance {{(pid=121153) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:28:44.999618 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-256766d8-8955-4bc3-915a-15c85dab051c tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "DELETE /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 204 len: 0 microversion: 2.1 time: 0.379800 Sep 14 12:28:45.003006 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 715/1440] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:28:44 2022] DELETE /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:28:45.014097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c9b24f47-a7f3-4e31-88f5-2e256556e19b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:45.014097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c9b24f47-a7f3-4e31-88f5-2e256556e19b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:45.017027 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c9b24f47-a7f3-4e31-88f5-2e256556e19b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:45.017585 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c9b24f47-a7f3-4e31-88f5-2e256556e19b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:45.018249 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c9b24f47-a7f3-4e31-88f5-2e256556e19b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:45.019132 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c9b24f47-a7f3-4e31-88f5-2e256556e19b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:45.019748 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c9b24f47-a7f3-4e31-88f5-2e256556e19b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:45.020330 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c9b24f47-a7f3-4e31-88f5-2e256556e19b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:45.192370 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-c9b24f47-a7f3-4e31-88f5-2e256556e19b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:28:45.200828 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c9b24f47-a7f3-4e31-88f5-2e256556e19b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1577 microversion: 2.1 time: 0.196308 Sep 14 12:28:45.201311 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 726/1441] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:28:45 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:28:46.227796 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-eefccb2d-d4f7-4b4a-b506-8e16edaa4172 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:46.228509 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-eefccb2d-d4f7-4b4a-b506-8e16edaa4172 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:46.235271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eefccb2d-d4f7-4b4a-b506-8e16edaa4172 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:46.236446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eefccb2d-d4f7-4b4a-b506-8e16edaa4172 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:46.236446 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eefccb2d-d4f7-4b4a-b506-8e16edaa4172 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:46.236890 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eefccb2d-d4f7-4b4a-b506-8e16edaa4172 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:46.237351 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eefccb2d-d4f7-4b4a-b506-8e16edaa4172 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:46.237780 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-eefccb2d-d4f7-4b4a-b506-8e16edaa4172 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:46.396829 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-eefccb2d-d4f7-4b4a-b506-8e16edaa4172 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:28:46.404574 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-eefccb2d-d4f7-4b4a-b506-8e16edaa4172 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1577 microversion: 2.1 time: 0.182153 Sep 14 12:28:46.405145 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 716/1442] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:28:46 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:28:47.428087 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-30696df0-9a90-4793-a736-11a832abf3ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:47.428687 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-30696df0-9a90-4793-a736-11a832abf3ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:47.435645 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30696df0-9a90-4793-a736-11a832abf3ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:47.436287 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30696df0-9a90-4793-a736-11a832abf3ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:47.436673 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30696df0-9a90-4793-a736-11a832abf3ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:47.437381 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30696df0-9a90-4793-a736-11a832abf3ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:47.437840 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30696df0-9a90-4793-a736-11a832abf3ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:47.443056 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-30696df0-9a90-4793-a736-11a832abf3ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:47.550988 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-30696df0-9a90-4793-a736-11a832abf3ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:28:47.559761 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-30696df0-9a90-4793-a736-11a832abf3ef tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1392 microversion: 2.1 time: 0.135726 Sep 14 12:28:47.563869 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 727/1443] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:28:47 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1392 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:28:47.822139 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-34bc169e-163c-4071-8681-5a1387a4f205 req-25e17745-9d8d-431f-93e7-fa1415971066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881fc53c-9264-4ba1-ac3d-e19c3934b098", "name": "network-vif-deleted", "tag": "71b95f96-2a69-42b2-83c1-cb56894b9e4b"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:28:47.832417 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-34bc169e-163c-4071-8681-5a1387a4f205 req-25e17745-9d8d-431f-93e7-fa1415971066 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:47.832898 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-34bc169e-163c-4071-8681-5a1387a4f205 req-25e17745-9d8d-431f-93e7-fa1415971066 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:47.833319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-34bc169e-163c-4071-8681-5a1387a4f205 req-25e17745-9d8d-431f-93e7-fa1415971066 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:47.854023 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-34bc169e-163c-4071-8681-5a1387a4f205 req-25e17745-9d8d-431f-93e7-fa1415971066 service nova] Creating event network-vif-deleted:71b95f96-2a69-42b2-83c1-cb56894b9e4b for instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 on hv-cinder-84496 Sep 14 12:28:47.859180 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-34bc169e-163c-4071-8681-5a1387a4f205 req-25e17745-9d8d-431f-93e7-fa1415971066 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266863 Sep 14 12:28:47.862192 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 717/1444] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:28:48.583060 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:48.583663 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:48.590040 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:48.590548 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:48.590983 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:48.591662 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:48.592111 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:48.592526 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:48.622273 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:48.622746 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:48.623176 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:48.623610 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lazy-loading 'fault' on Instance uuid 881fc53c-9264-4ba1-ac3d-e19c3934b098 {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:28:48.663405 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:28:48.671006 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-d1521931-1fc6-4c23-a815-780593c814aa tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 200 len: 1231 microversion: 2.1 time: 0.091772 Sep 14 12:28:48.671572 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 728/1445] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:28:48 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:28:49.695651 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:49.696378 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 881fc53c-9264-4ba1-ac3d-e19c3934b098] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:49.702489 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:49.702979 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:49.704101 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:49.704795 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:49.705252 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:49.705681 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:49.721044 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] HTTP exception thrown: Instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 could not be found. Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Request method failure captured: Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 HTTP/1.1 Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcbNMIgIGrYMNQSBMTsI6HNeFuUOApp2cYZhcfoQJes_UqSKr9HgdPJ6OleDOKX_ujNQHt1uC-KkM4_MG6V_5xh3itga4eMohCLze80vsKASE2qDG0MhdCl-y31FsgQ4qQSq08i8pnP7LaqGRVeumg5IJfBdN_bMbc98HIxBDeZKIS0 Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: e0cdab1c080d4132adc6cd64d8627c68 Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:28:49.722659 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0cdab1c080d4132adc6cd64d8627c68"}]}] Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: e0cdab1c080d4132adc6cd64d8627c68 Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-TestVolumeBootPattern-746487349-project Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 33f480ef1b8b49df83276a66f445ae85 Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestVolumeBootPattern-746487349-project Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 could not be found. Sep 14 12:28:49.724314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '881fc53c-9264-4ba1-ac3d-e19c3934b098'} Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 could not be found. Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:28:49.725283 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 could not be found. Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 could not be found. Sep 14 12:28:49.727094 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:49.728906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Returning 404 to user: Instance 881fc53c-9264-4ba1-ac3d-e19c3934b098 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:28:49.728906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-5d14cc50-f5bc-46d0-b124-6ba109142590 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098" status: 404 len: 111 microversion: 2.1 time: 0.033051 Sep 14 12:28:49.728906 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 718/1446] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:28:49 2022] GET /compute/v2.1/servers/881fc53c-9264-4ba1-ac3d-e19c3934b098 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:28:53.015620 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-c7246a6c-e02d-4525-8dcd-f82761e6e49d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:53.016288 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-0c5492ed-e878-40ea-bc04-12a6f0c03412 req-6279a64d-4749-4177-986c-b0b186038c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888bde55-8bd0-4899-b628-248ceca236ec", "tag": "36821828-5ed7-4142-9e1b-7030c1d1b519"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:28:53.016857 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c7246a6c-e02d-4525-8dcd-f82761e6e49d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:53.024444 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c7246a6c-e02d-4525-8dcd-f82761e6e49d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:53.024927 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c7246a6c-e02d-4525-8dcd-f82761e6e49d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:53.025356 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c7246a6c-e02d-4525-8dcd-f82761e6e49d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:53.025497 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0c5492ed-e878-40ea-bc04-12a6f0c03412 req-6279a64d-4749-4177-986c-b0b186038c77 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:53.026010 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0c5492ed-e878-40ea-bc04-12a6f0c03412 req-6279a64d-4749-4177-986c-b0b186038c77 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:53.026144 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c7246a6c-e02d-4525-8dcd-f82761e6e49d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:53.026517 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-0c5492ed-e878-40ea-bc04-12a6f0c03412 req-6279a64d-4749-4177-986c-b0b186038c77 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:53.026644 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c7246a6c-e02d-4525-8dcd-f82761e6e49d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:53.027097 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-c7246a6c-e02d-4525-8dcd-f82761e6e49d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:53.037942 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-0c5492ed-e878-40ea-bc04-12a6f0c03412 req-6279a64d-4749-4177-986c-b0b186038c77 service nova] Creating event network-changed:36821828-5ed7-4142-9e1b-7030c1d1b519 for instance 888bde55-8bd0-4899-b628-248ceca236ec on hv-cinder-84496 Sep 14 12:28:53.043208 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-0c5492ed-e878-40ea-bc04-12a6f0c03412 req-6279a64d-4749-4177-986c-b0b186038c77 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031267 Sep 14 12:28:53.044123 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 719/1447] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 12:28:53.057486 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-c7246a6c-e02d-4525-8dcd-f82761e6e49d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Going to try to terminate instance {{(pid=121152) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 12:28:53.373329 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-c7246a6c-e02d-4525-8dcd-f82761e6e49d tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "DELETE /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 204 len: 0 microversion: 2.1 time: 0.363742 Sep 14 12:28:53.374399 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 729/1448] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:28:53 2022] DELETE /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 12:28:53.383305 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-bbd74025-990f-43e2-afa4-b10d790b13c1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:53.384035 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-bbd74025-990f-43e2-afa4-b10d790b13c1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:53.391282 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbd74025-990f-43e2-afa4-b10d790b13c1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:53.391772 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbd74025-990f-43e2-afa4-b10d790b13c1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:53.392209 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbd74025-990f-43e2-afa4-b10d790b13c1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:53.392903 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbd74025-990f-43e2-afa4-b10d790b13c1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:53.393429 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbd74025-990f-43e2-afa4-b10d790b13c1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:53.393805 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-bbd74025-990f-43e2-afa4-b10d790b13c1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:53.530688 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.policy [None req-bbd74025-990f-43e2-afa4-b10d790b13c1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121153) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:28:53.539063 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-bbd74025-990f-43e2-afa4-b10d790b13c1 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1579 microversion: 2.1 time: 0.159890 Sep 14 12:28:53.540031 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 720/1449] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:28:53 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:28:54.563781 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-ca6195c7-52dc-4d51-b375-ae66869a50d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:54.564479 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-ca6195c7-52dc-4d51-b375-ae66869a50d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:54.570962 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ca6195c7-52dc-4d51-b375-ae66869a50d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:54.571439 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ca6195c7-52dc-4d51-b375-ae66869a50d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:54.572101 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ca6195c7-52dc-4d51-b375-ae66869a50d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:54.573037 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ca6195c7-52dc-4d51-b375-ae66869a50d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:54.573243 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ca6195c7-52dc-4d51-b375-ae66869a50d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:54.573660 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-ca6195c7-52dc-4d51-b375-ae66869a50d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:55.030686 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-ca6195c7-52dc-4d51-b375-ae66869a50d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:28:55.041671 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [req-cc0a9aa3-f28c-49fb-b9b9-c13b42f7280c req-4e46ae17-e9e9-4fec-b260-46d2c9a36a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888bde55-8bd0-4899-b628-248ceca236ec", "name": "network-vif-deleted", "tag": "36821828-5ed7-4142-9e1b-7030c1d1b519"}]} {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 12:28:55.042597 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-ca6195c7-52dc-4d51-b375-ae66869a50d2 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1460 microversion: 2.1 time: 0.482825 Sep 14 12:28:55.043253 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 730/1450] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:28:54 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1460 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:28:55.059832 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-cc0a9aa3-f28c-49fb-b9b9-c13b42f7280c req-4e46ae17-e9e9-4fec-b260-46d2c9a36a83 service nova] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:55.060314 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-cc0a9aa3-f28c-49fb-b9b9-c13b42f7280c req-4e46ae17-e9e9-4fec-b260-46d2c9a36a83 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:55.060745 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [req-cc0a9aa3-f28c-49fb-b9b9-c13b42f7280c req-4e46ae17-e9e9-4fec-b260-46d2c9a36a83 service nova] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:55.072808 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.compute.server_external_events [req-cc0a9aa3-f28c-49fb-b9b9-c13b42f7280c req-4e46ae17-e9e9-4fec-b260-46d2c9a36a83 service nova] Creating event network-vif-deleted:36821828-5ed7-4142-9e1b-7030c1d1b519 for instance 888bde55-8bd0-4899-b628-248ceca236ec on hv-cinder-84496 Sep 14 12:28:55.077716 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [req-cc0a9aa3-f28c-49fb-b9b9-c13b42f7280c req-4e46ae17-e9e9-4fec-b260-46d2c9a36a83 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039671 Sep 14 12:28:55.079393 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 721/1451] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Sep 14 12:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 12:28:56.065331 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:56.066096 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:56.072706 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:56.073188 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:56.073624 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:56.074343 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:56.074797 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:56.075219 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:56.106378 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:56.106859 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:56.107292 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:56.107732 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.objects.instance [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lazy-loading 'fault' on Instance uuid 888bde55-8bd0-4899-b628-248ceca236ec {{(pid=121152) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 12:28:56.148257 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.policy [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f480ef1b8b49df83276a66f445ae85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0cdab1c080d4132adc6cd64d8627c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121152) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 12:28:56.156143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-342b71f6-29b6-487c-9351-0a94da3f7c1b tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 200 len: 1231 microversion: 2.1 time: 0.094651 Sep 14 12:28:56.157302 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 731/1452] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:28:56 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 12:28:57.182183 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:57.182885 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 888bde55-8bd0-4899-b628-248ceca236ec] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:57.189514 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:57.190022 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:57.190459 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:57.191244 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:57.191631 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:57.192053 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:57.205611 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] HTTP exception thrown: Instance 888bde55-8bd0-4899-b628-248ceca236ec could not be found. Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Request method failure captured: Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec HTTP/1.1 Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcbNMIgIGrYMNQSBMTsI6HNeFuUOApp2cYZhcfoQJes_UqSKr9HgdPJ6OleDOKX_ujNQHt1uC-KkM4_MG6V_5xh3itga4eMohCLze80vsKASE2qDG0MhdCl-y31FsgQ4qQSq08i8pnP7LaqGRVeumg5IJfBdN_bMbc98HIxBDeZKIS0 Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: e0cdab1c080d4132adc6cd64d8627c68 Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:28:57.207271 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0cdab1c080d4132adc6cd64d8627c68"}]}] Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: e0cdab1c080d4132adc6cd64d8627c68 Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-TestVolumeBootPattern-746487349-project Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 33f480ef1b8b49df83276a66f445ae85 Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestVolumeBootPattern-746487349-project Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 888bde55-8bd0-4899-b628-248ceca236ec could not be found. Sep 14 12:28:57.209052 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '888bde55-8bd0-4899-b628-248ceca236ec'} Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888bde55-8bd0-4899-b628-248ceca236ec could not be found. Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:28:57.210319 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888bde55-8bd0-4899-b628-248ceca236ec could not be found. Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888bde55-8bd0-4899-b628-248ceca236ec could not be found. Sep 14 12:28:57.212204 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.213806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Returning 404 to user: Instance 888bde55-8bd0-4899-b628-248ceca236ec could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:28:57.213806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-54085ac3-b352-46eb-b812-05b815421649 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec" status: 404 len: 111 microversion: 2.1 time: 0.031256 Sep 14 12:28:57.213806 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 722/1453] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:28:57 2022] GET /compute/v2.1/servers/888bde55-8bd0-4899-b628-248ceca236ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:28:57.691526 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:57.692078 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.compute.api [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121152) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:57.698752 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:57.699227 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:57.699656 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:57.700335 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:57.700778 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:57.701193 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG oslo_concurrency.lockutils [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:57.714288 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.wsgi [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] HTTP exception thrown: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Request method failure captured: Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: request: DELETE /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 HTTP/1.1 Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept: application/json Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Accept-Encoding: identity Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Connection: close Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Length: 0 Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Content-Type: application/json Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Host: 10.222.0.62 Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: Openstack-System-Scope: None Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: User-Agent: python-urllib3/1.26.12 Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Auth-Token: gAAAAABjIcbNMIgIGrYMNQSBMTsI6HNeFuUOApp2cYZhcfoQJes_UqSKr9HgdPJ6OleDOKX_ujNQHt1uC-KkM4_MG6V_5xh3itga4eMohCLze80vsKASE2qDG0MhdCl-y31FsgQ4qQSq08i8pnP7LaqGRVeumg5IJfBdN_bMbc98HIxBDeZKIS0 Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Id: None Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Domain-Name: None Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Identity-Status: Confirmed Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Is-Admin-Project: True Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Id: default Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Domain-Name: Default Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Id: e0cdab1c080d4132adc6cd64d8627c68 Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Project-Name: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Role: reader,member Sep 14 12:28:57.715912 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Roles: reader,member Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0cdab1c080d4132adc6cd64d8627c68"}]}] Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Id: e0cdab1c080d4132adc6cd64d8627c68 Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-Tenant-Name: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User: tempest-TestVolumeBootPattern-746487349-project Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Id: default Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Domain-Name: Default Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Id: 33f480ef1b8b49df83276a66f445ae85 Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: X-User-Name: tempest-TestVolumeBootPattern-746487349-project Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: method: > Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: exception: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:28:57.717474 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: action_args: {'id': '75e2d5b4-de88-42a8-8e7c-d6dd04c49794'} Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:28:57.718491 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:28:57.720143 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.721883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Returning 404 to user: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. {{(pid=121152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:28:57.721883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-68e50d0c-85df-4d48-9df6-d830a8f06781 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "DELETE /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 404 len: 111 microversion: 2.1 time: 0.032178 Sep 14 12:28:57.721883 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 732/1454] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Sep 14 12:28:57 2022] DELETE /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:28:57.726148 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '>' {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:57.726817 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.compute.api [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] [instance: 75e2d5b4-de88-42a8-8e7c-d6dd04c49794] Fetching instance by UUID {{(pid=121153) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 12:28:57.732759 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:57.733240 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:57.733676 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:57.734895 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Acquiring lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 12:28:57.735343 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 12:28:57.735769 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG oslo_concurrency.lockutils [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Lock "e21ce7ae-c7c7-4dea-ab11-eea908a8281e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 12:28:57.748801 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.wsgi [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] HTTP exception thrown: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Request method failure captured: Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: request: GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 HTTP/1.1 Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept: application/json Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Accept-Encoding: identity Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Connection: close Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Length: 0 Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Content-Type: application/json Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Host: 10.222.0.62 Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: Openstack-System-Scope: None Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: User-Agent: python-urllib3/1.26.12 Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Auth-Token: gAAAAABjIcbNMIgIGrYMNQSBMTsI6HNeFuUOApp2cYZhcfoQJes_UqSKr9HgdPJ6OleDOKX_ujNQHt1uC-KkM4_MG6V_5xh3itga4eMohCLze80vsKASE2qDG0MhdCl-y31FsgQ4qQSq08i8pnP7LaqGRVeumg5IJfBdN_bMbc98HIxBDeZKIS0 Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Id: None Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Domain-Name: None Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Identity-Status: Confirmed Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Is-Admin-Project: True Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Id: default Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Domain-Name: Default Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Id: e0cdab1c080d4132adc6cd64d8627c68 Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Project-Name: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Role: reader,member Sep 14 12:28:57.750896 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Roles: reader,member Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e0cdab1c080d4132adc6cd64d8627c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e0cdab1c080d4132adc6cd64d8627c68"}]}] Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Id: e0cdab1c080d4132adc6cd64d8627c68 Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-Tenant-Name: tempest-TestVolumeBootPattern-746487349 Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User: tempest-TestVolumeBootPattern-746487349-project Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Id: default Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Domain-Name: Default Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Id: 33f480ef1b8b49df83276a66f445ae85 Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: X-User-Name: tempest-TestVolumeBootPattern-746487349-project Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: method: > Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: exception: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:28:57.752749 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: action_args: {'id': '75e2d5b4-de88-42a8-8e7c-d6dd04c49794'} Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: {{(pid=121153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 12:28:57.753633 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. Sep 14 12:28:57.755144 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: ERROR nova.api.openstack.wsgi Sep 14 12:28:57.756435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: DEBUG nova.api.openstack.wsgi [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Returning 404 to user: Instance 75e2d5b4-de88-42a8-8e7c-d6dd04c49794 could not be found. {{(pid=121153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 12:28:57.756435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: INFO nova.api.openstack.requestlog [None req-70ec28e5-5cb1-4e94-8d69-d7e8e61a5cde tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794" status: 404 len: 111 microversion: 2.1 time: 0.030134 Sep 14 12:28:57.756435 dv-cinder-844962-2-iscsi devstack@n-api.service[121153]: [pid: 121153|app: 0|req: 723/1455] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Sep 14 12:28:57 2022] GET /compute/v2.1/servers/75e2d5b4-de88-42a8-8e7c-d6dd04c49794 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 12:28:59.266860 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: DEBUG nova.api.openstack.wsgi [None req-dfe41fe3-ccf3-4f14-bbaa-6eddea78b546 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] Calling method '.version_select at 0x7f1c9997cdc0>' {{(pid=121152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 12:28:59.371200 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: INFO nova.api.openstack.requestlog [None req-dfe41fe3-ccf3-4f14-bbaa-6eddea78b546 tempest-TestVolumeBootPattern-746487349 tempest-TestVolumeBootPattern-746487349-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1225028685" status: 202 len: 0 microversion: 2.1 time: 0.108318 Sep 14 12:28:59.371704 dv-cinder-844962-2-iscsi devstack@n-api.service[121152]: [pid: 121152|app: 0|req: 733/1456] 10.222.0.62 () {58 vars in 1263 bytes} [Wed Sep 14 12:28:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1225028685 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)